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The  structure  of  linear  constant  finite-dimensional  dynamic  systems 
is  studied.   A  complete  system  of  invariants  is  obtained  for  the  equiva- 
lence classes  of  completely  controllable  and  observable  systems  defined 
by  similarity  transformations  on  the  state-space.   The  realization  of 
infinite  and  finite  impulse  response  matrix  sequences  is  considered  in 
this  framework.   This  leads  to  simple  and  efficient  complete  and  partial 
minimal  realization  algorithms.  "One  of  the  most  significant  properties 
of  the  algorithms  given  here  is  that  the  realizations  are  obtained  in  a 
canonical  form.   This  allows  a  useful  and  straightforward  parametriza- 
tion  of  all  possible  minimal  realizations  in  the  finite  impulse  response 
matrix  sequence  case. 

The  situation  often  arises  where  it  is  convenient,  possibly  neces- 
sary, to  realize  a  finite  impulse  response  matrix  sequence  with  a  system 
which  possesses  certain  properties  (stability,  arbitrary  poles,  cycli- 
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city,  etc.),  even  though  of  non-minimal  dimension.   The  questions  of 
existence  and  parametrization  of  non-minimal  realizations  of  finite  im- 
pulse response  matrix  sequences  are  studied.   Several  significant  new 
observations  are  made,  and  an  algorithm  is  given  to  obtain  all  partial 
realizations  of  specified  (non-minimal)  dimension.   The  construction  of 
stable  partial  realizations  and  partial  realizations  with  arbitrary 
poles  is  also  discussed.   Specific  attention  is  devoted  to  the  question 
of  minimality  of  these  realizations,  and  several  necessary  and/or  suffi- 
cient conditions  for  minimality  are  given. 

The  design  of  observers  for  linear  constant  finite-dimensional 
dynamic  systems  is  considered.   It  is  shown  that  an  observer  design  pro- 
blem can  be  converted  in  all  cases  to  a  partial  realization  problem. 
This  result  provides  a  new  application  for  partial  realization  theory. 
The  cases  of  observing  a  vector  linear  function  of  the  state  with  a  mi- 
nimal order  observer  or  a  minimal  order  observer  with  arbitrary  poles 
are  specifically  considered  in  the  framework  of  the  partial  realization 
theory  results  developed  here.   Due  to  the  nature  of  the  partial  reali- 
zation algorithms,  considerable  information  is  gained  about  the  struc- 
ture and  properties  of  all  possible  observers  for  a  given  vector  linear 
function  of  the  state.   New,  simple  proofs  are  given  for  well-known  re- 
sults, and  several  new  results  are  derived.   It  is  shown  how  these  re- 
sults can  be  effectively  used  to  design  minimal  order  observers,  minimal 
order  observers  with  arbitrary  poles,  and  intermediate  order  observers 
for  a  given  vector  linear  function  of  the  state.   Some  of  the  previous 
observer  design  techniques  are  examined  in  the  light  of  partial  realiza- 
tion theory, and  their  correspondence  with  other  non-minimal  partial  re- 
alization algorithms  is  shown. 
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CHAPTER  1 
INTRODUCTION 

A  considerable  amount  of  the  research  effort   in  the  last  decade 
has  been  dedicated  to  studying  the  basic  internal  structure  of  linear 
dynamical  systems,  the  so-called  realization  problem,  and  the  design  of 
observers.   The  research  reported  in  this  work  is  concerned  mainly  with 
realization  theory  and  observer  design,  but  considerable  attention  is 
also  devoted  to  the  structure  of  linear  dynamical  systems  because  any 
significant  discussion  of  these  two  problems  almost  invariably  involves 
the  basic  structure  and  properties  of  linear  systems.   At  first  glance, 
it  may  seem  a  bit  unorthodox  that  realization  theory  and  observer  theory 
be  discussed  side-by-side,  but  it  is  shown  that  a  realization  problem 
evolves  quite  naturally  from  an  observer  design  problem.   This  new  re- 
sult is  not  so  surprising  after  one  carefully  examines  the  basic  con- 
cepts of  realization  theory  and  observer  theory. 

A  (complete)  realization  problem  consists  of  processing  the  im- 
pulse response  data  of  a  linear  dynamic  system  to  obtain  a  model  of  the 
system  in  the  form  of  several  first-order  linear  differential  (or  dif- 
ference) equations  in  the  state  of  the  system.   Such  models  are  compactly 
described  by  a  triple  of  matrices:   the  system  (or  transition)  matrix, 
the  input  matrix,  and  the  output  matrix.   The  usual  formulation  of  the 
problem  (and  common  sense)  further  requires  that  such  a  triple  be  of 
minimal  size.   The  minimality  requirement  intuitively  implies  complete 
controllability  and  observability  of  the  matrix  triple;  Kalman  (1963) 
proved  this  intuitive  notion  to  be  true. 


An  observer  is  a  linear  dynamic  system  which  processes  the  input/ 
output  information  of  a  completely  observable  linear  dynamic  system  and 
provides  an  asymptotic  estimate  of  the  state  of  the  system  which  it  ob- 
serves.  The  estimate  is  termed  asymptotic  because  the  error  between 
the  state  of  the  system  and  the  output  of  the  observer  decreases  expo- 
nentially to  zero  at  a  rate  dictated  by  the  dynamics  of  the  observer. 
This  estimate  can  be  used,  for  example,  to  implement  an  (asymptotic) 
approximation  of  a  state  variable  feedback  control  law  for  the  observed 
system.   Obviously,  a  desirable  design  objective  is  to  construct  the  ob- 
server with  the  minimal  number  of  dynamic  components. 

Consider  now  the  above  (rather  loose)  descriptions  of  a  realization 
problem  and  an  observer  design  problem.   Notice  that  to  solve  a  realiza- 
tion problem  one  has  to  develop  a  "machinery"  (a  series  of  mathematical 
operations)  to  process  input/output  data  (impulse  response  data,  to  be 
more  specific)  of  a  system  with  the  goal  of  obtaining  an  internal (  state- 
space)  description  of  the  system.   Notice  also  that,  in  a  sense,  an  ob- 
server is  a  "machinery"  which  processes  the  input/output  data  of  a  known 
system  and  produces  an  estimate  of  the  state  (internal  behavior)  of  the 
system  which  it  observes.   Further,  minimality  is  a  highly  desirable 
quality  for  a  solution  to  both  a  realization  problem  and  an  observer 
design  problem.   This  heuristic  discussion  points  out  the  similarity 
which  exists  between  both  concepts.   Of  course,  a  more  rigorous  develop- 
ment will  be  provided  later  on. 

It  is  interesting  to  notice  that  the  developments  in  realization 
theory  and  observer  theory  have  occurred  in  parallel,  with  most  of  the 
results  appearing  in  the  last  four  or  five  years. 


Survey  o(  Provioiis  Work  in 
Realization  Theory 

Kalman  (1963),  Gilbert  (1963),  and  Zadeh  and  Desoer  (1963)  wore 
probably  the  first  researchers  to  consider  the  realization  problem  in 
the  modern  control  theory  context.   They  formulated  the  problem  as  that 
of  obtaining  a  minimal  (completely  controllable  and  observable)  state- 
space  representation  of  a  system  given  the  transfer  function  matrix. 
Gilbert  (1963)  and  Zadeh  and  Desoer  (1963)  describe  a  realization  pro- 
cedure based  on  the  rank  of  the  residue  matrices  of  the  given  transfer 
function.   The  dimension  of  the  minimal  realization  is  equal  to  the  sum 
of  the  ranks  of  the  residue  matrices,  and  the  realization  is  obtained 
in  Jordan  canonical  form  (see,  for  example,  Gantmacher,  1959,  Vol.  1). 
The  multiplicity  of  a  pole  in  the  realization  is  given  by  the  rank  of 
the  residue  matrix  at  that  pole.   This  procedure  assumes  that  the  poles 
in  the  given  transfer  function  are  of  multiplicity  one.   The  algorithm 
proposed  by  Kalman (  1963)  consists  of  realizing  the  given  transfer  func- 
tion as  a  parallel  combination  of  single-input,  controllable  subsystems 
(single-output,  observable  subsystems)  in  companion  form,  and  then  apply- 
ing the  so-called  canonical  structure  theorem  (Kalman,  1962)  to  delete 
the  unobservable  (uncontrollable)  dynamics.   This  approach  handles  equally 
well  simple  and  multiple  poles  in  the  transfer  function. 

At  an  earlier  date,  McMillan  (1952)  had  discussed  the  network  theory 
problem  of  obtaining  the  degree  of  a  rational  matrix.   Kalman  (1965)  was 
the  first  to  show  that  the  realization  problem  as  formulated  in  control 
theory  is  equivalent  to  the  network  theory  formulation.   The  recently 
developed  system  matrix  approach  of  Rosenbrock  (1970)  also  gives  con- 
siderable insight  to  the  unification  of  the  two  lines  of  research. 


In  1966,  Ho  and  Kalman  (1966)  showed  that  the  realization  problem 
can  be  formulated  and  solved  in  the  more  tractable  setting  of  matrix  al- 
gebra.  As  before,  the  desired  end  result  is  a  minimal  state-space  rep- 
resentation  of  the  system,  but  now  the  infinite  impulse  response  matrix 
sequence,  rather  than  the  transfer  function  matrix,  is  the  starting  in- 
formation.  From  the  impulse  response  data  the  so-called  generalized 
Hankel  array  is  formed,  and  the  problem  becomes  one  of  studying  the  rank 
and  null  space  of  the  Hankel  array.   Notice  that  given  the  impulse  re- 
sponse matrix  sequence  instead  of  the  transfer  function  matrix,  the  re- 
alization problem  is  more  complicated  because  the  minimal  polynomial  of 
the  system  is  not  available. 

The  work  of  Ho  and  Kalman  (1966)  gave  new  impetus  to  realization 
theory.   Since  then,  several  authors  have  dedicated  their  efforts  to  ex- 
tend and/or  improve  the  original  results  of  Kalman  (1963),  Gilbert  (1963), 
and  Zadeh  and  Desoer  (1963),  and  to  provide  alternate  and/or  improved 
realization  algorithms  based  on  the  Hankel  array  formulation.   Mayne 
(1968),  Panda  and  Chen  (1969),  Roveda  and  Schmid  (1970),  Lai  et  al. 
(1972),  and  Huang  (  1974) ,  among  others,  considered  the  older  transfer 
function  matrix  approach,  while  Rissanen  (1971,  1974),  Ackermann  and 
Bucy  (1971),  Silverman  (1971),  Chen  and  Mital  (1972),  Mital  and  Chen 
(197  3), and  Bonivento  et  al.  (1973)  approached  the  problem  from  the  Hankel 
array  formulation.  - 

Rissanen  (1974)  and  Dickinson  et  al.  (1974a,  b)  have  recently  con- 
sidered the  problem  of  realizing  a  given  infinite  impulse  response  ma- 
trix sequence  with  a  polynomial  matrix  pair.   Such  a  polynomial  matrix 
pair  is  referred  to  as  a  matrix-fraction  description  of  the  system,  and 


is  becoming  commonplace  in  the  control  literature,  largely  due  to  the 
ground  work  established  by  Popov  (1969),  Rosenbrock  (1970),  Wolovich 
(1972a,  b,  1973a,  b)  and  others. 

The  Hankel  array  formulation  is  used  in  this  work.   The  realization 
algorithms  of  Rissanen  (1971),  Ackerman  and  Bucy  (1971)  and  Mital  and 
Chen  (1972)  are  discussed  in  Chapter  2.   A  complete  realization  algorithm 
related  to  that  of  Bonivento  et  al .  (1973)  and  Rissanen  (1974)  is  also 
discussed  at  length  in  Chapter  2.   Several  significant  points  that  they 
fail  to  indicate   are  brought  to  light  in  the  discussion  (the  most  sig- 
nificant being  a  recursiveness  which  is  inherent  in  the  algorithm). 

Kalman  (1971b)and  Tether  (1970)  later  considered  the  more  realistic 
case  where  only  a  finite  number  of  terms  of  the  impulse  response  sequence 
are  specified.   This  variant  is  commonly  known  as  the  partial  realization 
problem,  and  corresponds  (in  the  scalar  case)  to  the  Fade  approximation 
problem  of  classical  theory.   The  partial  realization  problem  has  several 
interesting  features  of  its  own,  the  most  significant  one  being  that  a 
partial  realization  (whether  minimal  or  not)  is  generally  not  unique. 

The  complete  realization  algorithms  of  Rissanen  (1971)  and  Ackermann 
and  Bucy  (1971)  (see  Ackermann,  1972)  can  be  easily  adapted  for  use  in 
the  partial  realization  context.   However,  these  two  algorithms  (as  well 
as  that  of  Kalman,  1971b, and  Tether,  1970)  are  not  very  effective  in  re- 
cognizing and  handling  the  degrees  of  freedom  generally  available  in 
partial  realizations. 

One  of  the  contributions  of  this  dissertation  is  a  partial  realiza- 
tion algorithm  which  identifies  the  minimal  number  of  realization  parame- 
ters while  at  the  same  time  conserves   all  the  available  degrees  of 


freedom.   This  property  of  the  algorithm  allows  one  to  characterize  all 
possible  partial  realizations  (both  minimal  and  non-minimal)  in  a  simple 

rufiii. 

In  the  last  few  years,  several  intersting  extensions  have  emerged 
from  the  original  concept  of  realization  theory.   The  work  of  Gopinath 
(1969),  Budin  (1971,  1972),  Bonivento  et  al.  (1973),  and  Audley  and  Rugh 
(1973)  is  concerned  with  obtaining  a  state-space  representation  given 
a  general  input/output  map  (not  necessarily  the  impulse  response)  of  a 
system.   The  results  of  Gopinath  (1969),  Budin  (1971,  1972),  and  Bonivento 
et  al.  (1973)  (see  Bonivento  and  Guidorzi,  1971)  can  be  generalized  to 
the  cases  where  the  given  data  is  contaminated  by  noise.   In  these  cases, 
an  estimate  of  the  sytem  parameters  is  obtained.   Rissanen  and  Kailath 
(1972),  Gupta  and  Fairman  (1974),  and  Akaike  (1974)  have  also  considered 
the  realization  of  stochastic  systems.   Both  of  these  problems  (realiza- 
tion from  general  input/output  maps  and  realization  of  stochastic  sys- 
tems) show  some  of  the  overlap  that  exists  between  the  research  areas 
of  realization  theory  and  system  identification  theory. 

Another  interesting  area  which  is  currently  receiving  considerable 
attention  is  that  of  bilinear  systems  (nonlinear  systems  in  which  the 
nonlinearities  enter  the  state  differential  equations  as  first  order 
products  of  the  states  with  the  inputs).   Isidori  (1973)  and  Bruni  et  al. 
(1974),  among  others,  have  made  extensive  contributions  in  this  area, 
particularly  for  the  problem  of  constructing  minimal  bilinear  realiza- 
tions from  nonlinear  input/output  maps. 

Research  in  realization  theory  and  its  applications  continues.  The 
results  discussed  in  this  dissertation  will  hopefully  guide  the  way  for 


new  applications  of  realization  theory,  observer  design  theory,  and 
other  related  fields.   Chapter  5  presents  some  suggestions  for  future 


resLvi  rcli . 


Survey  of  Previous  Work  in 
Observer  Design  Theory 

In  196A  Luenberger  (1964)  introduced  observers  as  the  deterministic 
counterparts  of  the  statistical  estimators  of  Kalman  and  Bucy  (1961). 
(A  statistical  estimator  is  a  system  which  processes  the  noise-corrupted 
input/output  information  of  a  system  and  provides  a  minimum  variance 
estimate  of  the  state  of  the  system.)   The  structure  of  observers  and 
statistical  estimators  is  the  same.   However,  they  differ  mainly  in  the 
following  two  considerations:   a)  the  dynamics  of  an  observer  are  prac- 
tically arbitrary,  while  the  dynamics  of  a  statistical  estimator  are  de- 
termined by  the  noise  processes,  and  b)  the  dimension  of  an  observer  can 
be  considerably  less  than  the  dimension  of  the  system  which  it  observes 
while  the  dimension  of  a  statistical  estimator  is  always  equal  to  the 
dimension  of  the  system  which  it  estimates  (provided  all  the  available 
output  measurements  are  corrupted  by  additive  noise).   These  differences 
are  sufficient  to  cause  the  respective  design  techniques  to  be  consider- 
ably different.   Only  deterministic  observers  for  linear,  time-invariant 
systems  are  considered  in  this  work. 

Luenberger  (1964)  considered  first  the  design  of  observers  for  sin- 
gle output  systems  only.   He  showed  that  an  observer  of  dimension  equal 
to  the  number  of  system  states  (n)  minus  the  number  of  linearly  inde- 
pendent system  outputs  (r)  can  be  designed  for  multiple  output  systems, 
but  did  not  propose  a  procedure  to  do  so.   He  also  showed  that  if  the 
observer  output  is  used  in  place  of  the  unmeasurable  state  in  a  state 


v;,,i..l.l.'  icc.clb.nk  .onLrol  liw,  Llu-n  L  he  ov.-r.-.ll  sysUMn-(>l>sr  rvc  r  |.olrs 
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(if  1  lie  observer  . 

Two  years  later,  Luenberger  (1966)  extended  his  original  results 
and  proposed  a  technique  to  design  observers  for  multiple  output  sys- 
tems.  He  further  proved  (by  construction)  that  the  dimension  of  the 
observer  can  be  as  low  as  v  -  1  <  n  -  r  where  V  is  the  observability 
index  of  the  observed  system  (see  Definition  (2.18)),  if  a  scalar  linear 
function  of  the  state,  rather  than  the  complete  state,  is  to  be  observed 

Since  then,  several  researchers  have  undertaken  the  task  of  study- 
ing the  properties  of  observers  and  pursuing  design  procedures  simpler 
than  the  original  procedures  of  Luenberger  (1964,  1966).   Bongiorno  and 
Youla  (1968)  proposed  a  new  observer  design  technique  and  showed  that 
if  the  estimate  of  a  system's  state  provided  by  an  observer  is  to  re- 
place the  state  in  an  optimal  (with  respect  to  a  quadratic  performance 
index)  control  law,  then  proper  care  must  be  exercised  in  selecting  the 
location  of  the  observer  poles  in  order  to  avoid  excessive  degradation 
in  the  value  of  the  optimal  cost  functional  (see  also  Bongiorno  and 
Youla,  1970).   Recently,  Bongiorno  (1973)  considered  the  related  prob- 
lem of  observer  design  for  insensitivity  of  a  quadratic  performance  in- 
dex to  variations  in  the  observed  system  parameters,  and  showed  that 
complete  insensitivity  is,  in  general,  unattainable.   Wonham  (1970) 
studied  the  properties  of  observers  from  the  geometric  point  of  view 
and  removed  some  existing  restrictions  on  the  allowable  locations  for 
the  observer  poles (  that  the  observer  and  observed  system  cannot  have 
any  poles  in  common,  and  that  some  observer  poles  are  allowed  to  assume 
real  values  exclusively). 


Among  the  several  observer  design  techniques  that  appeared  in  the 
ni'xt  few  yenrs  arc  those  of  Johnson  (1969),  ("opinath  (1971),  .lanu-son 
and  Rothschild  (1971),  and  Munro  (1973,  1974).   These  procedures  arc 
all  based  on  state  variable  descriptions  of  both  the  system  and  observ- 
er.  Among  these,  notable  for  their  simplicity  are  the  (related)  design 
techniques  of  Johnson  (1969)  and  Gopinath  (1971).   A  transfer  function 
matrix  description  observer  design  method  has  been  proposed  by  Retallack 
(1970),  and  Wolovich  (1973a)  has  used  the  matrix-fraction  description 
approach  to  design  observers. 

When  the  literature  became  saturated  with  design  procedures  to  ob- 
serve the  complete  state,  researchers  turned  naturally  to  the  more  dif- 
ficult problems  of  designing  observers  to  approximate  scalar  and  vector 
linear  functions  of  the  state  with  minimal  and/or  low  order  observers. 
For  the  scalar  linear  function  case,  the  efforts  of  Jameson  and  Roth- 
schild (1971),  Wonham  and  Morse  (1972),  and  Murdoch  (1973)  resulted  in 
three  different  techniques  to  design  an  observer  of  dimension  equal  to 
V  -  1  and  with  arbitrary  poles.   Anderson  and  Moore  (1971)  give  an  ex- 
cellent discussion  of  the  original  solution  proposed  by  Luenberger  (1966) 
for  this  case.   Williamson  (1970),  Wang  and  Davison  (1973),  and  Roman 
et  al.  (1973)  considered  the  problem  of  designing  observers  of  dimension 
less  than  V  -  1  and  with  restricted  pole  positions. 

For  the  case  of  observing  vector  linear  functions  of  the  state  a 
brute-force  solution  has  been  proposed  by  Jameson  and  Rothschild  (1971). 
They  suggest  observing  every  row  of  the  vector  function  with  a  (v-1)- 
dimensional  observer  and  then  combining  the  individual  observers  in 
parallel  into  a  single  m(v-l)-dimensional  observer  (where  m  is  the  num- 
ber of  rows  of  the  given  vector  linear  function).   Wolovich  (1973a) 
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formulated  the   observer  design  problem  in  terms  of  matrix-fraction  de- 
s.riplions,  and  obtained  a  result  wb  i  oh  is  equivalent  to  (bat  ol  .lanu.'.on 
an<l  Rotbscbild  (1971).   It  is  noted  that  their  solution  is  not  minimal 
except  in  very  unusual  cases.   Murdoch  (1974)  goes  one  step  farther  than 
Jameson  and  Rothschild  (1971)  and  allows  coupling  in  the  forward  direc- 
tion between  the  individual  observers.   This  reduces  considerably  the 
dimension  of  the  overall  observer,  but  is  still  a  non-minimal  solution 

in  most  cases. 

Fortmann  and  Williamson  (1972)  proposed  a  method  which  consists 
of  designing  r  minimal  order  subobservers  to  estimate  r  partitions  of 
the  given  set  of  vector  linear  functions  and  then  combining  the  subob- 
servers in  parallel  to  obtain  the  overall  observer.   Tliis  procedure  is 
a  dual  of  the  solution  proposed  by  Jameson  and  Rothschild  (1971),  and 
correspondingly  gives  non-minimal  observers  except  in  very  special  cases, 

The  strongest  results  available  prior  to  this  work  for  the  problem 
of  observing  vector  linear  functions  of  the  state  are  due  to  Wang  and 
Davison  (1973)  and  Roman  and  Bullock  (1974).   Wang  and  Davison  (197  3) 
reformulate  the  problem  in  transfer  function  matrix  terms  as  follows: 
given  two  rational  matrices  fi(s)  and  A(s)  (the  transposes  of  the  system 
transfer  function  matrix  and  the  desired  overall  transfer  function  ma- 
trix, respectively),  find  a  rational  matrix  A(s)  (the  transpose  of  the 
observer  transfer  function  matrix)  of  lowest  possible  McMillan  degree 
(see  McMillan,  1952;  also,  Rosenbrock,  1970)  such  that 
(1.1)  f^(s)A(s)  =  A(s) 

Substituting  the  matrix-fraction  description  for  each  of  the  transfer 
functions  in  (1.1)  and  performing  some  straightforward  manipulations, 
they  represent  (1.1)  in  a  form  in  which  it  is  possible  to  solve  for  the 
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minimal  A(s)  that  satisfies  this  relation.  However,  there  is  no  guaran- 
tee that  the  poles  are  located  so  that  A(s)  will  be  stable.  If  A(s)  is 
unstable,  it  does  not  qualify  for  the  transfer  function  of  an  observer. 
Thus,  Wang  and  Davison  (1973)  cannot  design  a  minimal  order  observer  in 
every  case,  and  further,  the  success  or  failure  of  the  technique  is  not 
known  until  A(s)  has  been  computed. 

The  results  described  by  Roman  and  Bullock  (1974)  are  a  preliminary 
version  of  the  observer  design  procedures  proposed  in  this  dissertation, 
and  are  amply  discussed  in  the  sequel.   Several  of  the  above-mentioned 
observer  design  techniques  are  also  discussed  in  Chapter  4  and  compared 
with  the  methods  presented  here.   Specifically,  the  observer  design  tech- 
niques reported  by  Luenberger  (1966),  Gopinath  (1971),  Munro  (1973,1974), 
Fortmann  and  Williamson  (1972),  and  Murdoch  (1974)  are  examined  in  more 

detail. 

Several  extensions  to  the  original  observer  design  problem  have 
been  formulated  and  discussed  in  the  last  few  years.   Wolovich  (1968), 
Johnson  (1969),  Williamson  (1970),  Yuksel  and  Bongiorno  (1971),  and 
Watts  and  McDaniel  (1973)  have  considered  the  design  of  observers  for 
time-varying  systems,  and  Stavroulakis  and  Sarachik  (1973)  have  studied 
the  design  of  observers  for  distributed  parameter  systems. 

Haley  (1967)  and  Russell  and  Bullock  (1974)  considered  the  design 
of  low  order  observers  for  square  systems  (systems  having  equal  number 
of  inputs  and  outputs)  using  approximation  techniques. 

Guidorzi  and  Marro  (1971),  Hostetter  and  Meditch  (1973),  and  Meditch 
and  Hostetter  (1973)  discuss  the  problem  of  designing  observers  for  sys- 
tems with  unmeasurable  inputs. 
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■|'Ik'  (k'sign  i)f  observers  fer  nonlinear  systems  lias  been  diseiisseil 
l.v  Williamson  (i')/0),  Tliau  (IT/l),  and  Koii  el  al.  (i'f/n  |  foin  tin.-.-  .lil- 
ferent  points  of  view. 

The  so-called  observer-estimators,  which  are  observers  for  stoilias- 
tic  systems  which  have  some  noise-free  measurements,  were  introduced  by 
Tse  and  Athans  (1970).   These  are  becoming  increasingly  popular  due  to 
their  practical  applications.   Among  the  various  researchers  that  have 
since  considered  this  problem  are  Iglehart  and  Leondes  (1972),  Tse  (1973a) 
Leondes  and  Novak  (1974),  Kwatny  (1974),  and  Uttam  and  O'Halloran  (1975). 

Carroll  and  Lindorff  (1973,  1974)  originated  the  adaptive  observer 
trend,  and  Luders  and  Narendra  (1973,  1974a,  b) ,  and  Tse  (1973b)  have 
followed  closely.   More  recently,  Morse  (1974)  has  studied  the  design 
of  adaptive  observers  using  the  powerful  algebraic  tools  developed  by 
Morse  and  Wonham  (1970). 

All  indications  seem  to  be  that  future  research  will  be  mostly  in 
the  design  of  observer-estimators,  adaptive  observers,  and  observers  for 
nonlinear  systems.   However,  most  of  the  other  areas  mentioned  above 
have  not  been  completely  exhausted,  and  still  offer  considerable  chal- 
lenge . 

Statement  of  Purpose  and 
Chapter  Outline 

It  is  the  purpose  of  this  disseration  to  provide  an  extensive  dis- 
cussion of  realization  theory  and  present  complete  and  partial  realiza- 
tion algorithms  which  are  superior  to  other  existing  algorithms.   Also, 
two  new  partial  realization  problems  of  interest  in  applications  are 
defined.   They  are  the  minimal  partial  stable  and  the  minimal  partial 
arbitrary  realization  problems.   Solutions  for  these  problems  are 
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presented.   Then  the  previously  unsolved  problems  of  designing  minimal 
..nU-r  observers  and  minimal  order  observers  with  arbitrary  poles  to 
estimate  vector  linear  functions  of  the  state  are  considered.   It  is 
shown  that  these  problems  can  be  formulated  as  partial  realization  prob- 
lems, and  the  partial  realization  algorithms  given  here  are  applied  to 
obtain  a  solution  which  has  several  significant  features.   In  passing, 
a  considerable  amount  of  knowledge  about  the  existence  and  structure  of 

observers  is  gained. 

An  outline  by  chapters  follows.   The  invariant  structure  of  linear, 
constant  systems  and  the  minimal  realization  of  infinite  and  finite  im- 
pulse response  matrix  sequences  are  discussed  in  Chapter  2.   Two  realx- 
zation  algorithms  (one  complete  and  the  other  partial)  are  presented. 

The  cases  where  a  stable  realization  or  a  realization  with  arbitrary 
poles  must  be  obtained  for  a  finite  matrix  sequence  are  considered  and 
solved  in  Chapter  3  through  an  extension  of  the  concepts  and  algorithms 
given  in  Chapter  2. 

In  Chapter  4  the  design  of  minimal  order  observers,  minimal  order 
observers  with  arbitrary  poles,  and  intermediate  order  observers  (to 
estimate  vector  linear  functions  of  the  state)  is  formulated  in  terms  of 
partial  realization  theory  and  the  results  of  the  preceding  chapters  are 
applied  to  the  specific  context  of  observers. 

The  specific  contributions  of  this  research  and  further  research 
possibilities  are  outlined  in  Chapter  5. 

Examples  are  used  generously  throughout  this  work  to  illustrate  the 
various  realization  algorithms  discussed  and  to  point  out  significant 
details  that  are  otherwise  difficult  to  see.   A  comment  on  the  notation 
to  be  used  throughout  this  dissertation  closes  this  chapter. 
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(1.2)   Notation.   Uppercase  letters  denote  matrices,  and  vectors  are 
rcprosentcHl  by  underlined  lowercase  letters.   Lowercase  letters  aie  ii.scil 
to  represent  scalars  and  integers.   Sets  and  their  elements  are  denoted 
by  upper-  and  lowercase  script  letters,  respectively. 

Lowercase  Greek  symbols  are  used  (with  a  few  exceptions)  to  denote 
the  invariants  of  the  group  of  similarity  transformations  on  the  state- 
space  of  linear  systems,  and  occasionally,  to  represent  polynomials. 
Uppercase  Greek  symbols  stand  for  polynomial  matrices  or  rational  matri- 
ces. 

Several  auxiliary  matrices  and  vectors  are  represented  by  upper- 

and  lowercase,  respectively,  light  italic  type  elements.   The  symbol  5f 

stands  for  the  so-called  generalized  Hankel  matrix.   All  the  matrices 

and  vectors  appearing  in  this  work  are  assumed  to  be  real  and  constant. 

1   represents  the  nxn  identity  matrix,  and  i.  stands  for  its  i th  column, 
n  ^        '     -J  -* 

A  pxq  null  matrix  is  denoted  by  0    ,  and  0   is  one  of  its  columns.      V 


CHAPTER  2 
COMPLETE  AND  PARTIAL  REALIZATION  THEORY 

In  this  chapter  the  problems  of  realizing  a)  an  infinite,  and  b) 
a  finite  (or  partial)  matrix  sequence  with  a  system  of  minimal  order 
are  formulated  and  discussed.   A  complete  system  of  input  invariants  of 
the  complete  and  partial  realization  problems  is  obtained,  and  a  state- 
space  canonical  description  is  defined.   It  is  shown  that  the  columns 
of  the  so-called  Hankel  array  and  the  columns  of  the  matrices  in  the 
given  sequence  satisfy  a  set  of  recurrence  relations  defined  by  the  sys- 
tem of  input  invariants  of  the  realization.   Based  on  these  results, 
realization  algorithms  are  presented  to  solve  the  above-mentioned  prob- 
lems.  These  algorithms  have  the  significant  feature  that  the  realiza- 
tion is  obtained  in  canonical  form,  and  further,  the  complete  realiza- 
tion algorithm  is  of  quasi-recursive  nature. 

The  theory  of  complete  and  partial  realizations  has  been  discussed 
extensively  in  the  control  literature  since  the  pioneering  work  of 
Gilbert  (1963),  Kalman  (1963),  Zadeh  and  Desoer  (1963),  and  Ho  and 
Kalman  (1966).   The  contribution  of  this  chapter  lies  in  the  description 
of  new  realization  algorithms.   Results  similar  to  those  described  here 
have  appeared  recently  in  the  complete  realization  context  (Bonivento 
et  al.,  1973;  Rissanen,  1974;  Akaike,  1974),  but  several  significant 
points  which  are  discussed  here  seem  to  have  been  overlooked  elsewhere. 
Further,  it  should  be  noted  that  the  complete  realization  algorithm 
given  here  was  derived  independently  of  these  papers. 
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Problem  Statement 
Consider  a  system  of  the  form 

(2.1a)         A  =  A>^  +  ^ 
(2. lb)         n  =  D A 

where  A  is  the  p-dimensional  state  vector,  u)  is  the  r-dimensional  input 
vector,  ji  is  the  m-dimensional  output  vector,  and  A,  Q,  D  are  matrices 
of  appropriate  dimensions.   System  (2.1)  is  also  denoted  by  the  matrix 
triple  (A,Q,D)  .   Without  loss  of  generality,  it  is  assumed  that  (2.1) 
defines  a  completely  controllable  and  observable  system.   For  notational 
simplicity,  let  p(Q)  =  r,  p(D)  =  m. 

The  transfer  function  matrix  of  (2.1)  is  given  by 

CO 

(2.2)  <l>(s)  =  D[sl  -  A]"^Q  =  I     L  s"^ 

i=l 

and  the  impulse  response  matrix  of  (2.1)  is  given  by 

oo    i-l  i-l         00    ^i-l 

(2.3)  L(t)  =  De  ^Q  =  D[^    (i_i)  ;   iQ  =   I   (i.i)  !  L. 

Thus,  an  alternate  description  of  (2.1)  consists  of  the  infinite  matrix 
sequence  {L,L  ,...}.   This  leads  to  the  following  definition  of  the 
minimal  complete  realization  problem. 

(2.4)  Definition.   Given  an  infinite  sequence  {L  ,L  , ...}  of  mxr 

matrices  which  define  the  impulse  response  of  a 

finite-dimensional  system  (2.1),  find  a  triple 

(A,Q,D)   such  that 
P 


The  notation  used  in  this  chapter  differs  considerably  from  the  stan- 
dard notation.   This  discrepancy  is  introduced  in  the  interest  of 
simplifying  the  notation  in  a  subsequent  chapter. 


17 


a)  L.  =  DA^  ^Q  i  =  1,2,. . . 

b)  p  is  minimal. 

The  triple  (A,Q,D)   is  then  said  to  be  a  minimal 
complete  realization  of  {L,L  ,...}. 
In  a  practical  situation,  the  input/output  data  is  available  only 
partially.   Thus,  a  more  realistic  problem  is  the  minimal  partial  re- 
alization problem,  which  is  defined  as  follows. 

(2.5)  Definition.   Given  a  finite  sequence  {L, ,L„ , . . . ,L.^  }  of  mxr 

i   z       Wo 

matrices  which  define  the  first  No  terms  in  the 
impulse  response  of  a  (possibly  infinite- 
dimensional)  system,  find  a  triple  (A,Q,D)   such 
that 

a)  L.  =  DA^~^Q  i  =  1,2,.  ..  ,N(, 

b)  p  is  minimal. 

The  triple  (A,Q,D)   is  then  said  to  be  a  minimal 
partial  realization  of  {L,,L  ,...,L   } 

i   /        iMo 

(2.6)  Remark.   For  a  continuous-time  system,  as  (2.1),  the  low-index 
terms  of  the  sequence  {L.,L„,...}  define  the  high-frequency  response  of 
(2.1).   Thus,  realizing  the  first  No  terms  of  the  sequence  {L^,L„,...} 
may  result  (depending  on  the  size  of  No)  in  a  system  which  does  not 
give  a  satisfactory  low-frequency  (steady-state)  response.   It  is  well 
known  (Ho  and  Kalman,  1966)  that  for  discrete-time  systems  the  realiza- 
tion problem  can  be  defined  in  the  exact  same  form  as  above.   However, 
in  the  discrete-time  case  the  value  of  the  impulse  response  at  the  ith 
sampling  instant  is  given  by  L..   Thus,  a  minimal  partial  realization 
of  the  impulse  response  sequence  of  a  discrete-time  system  matches  ex- 
actly the  desired  input/output  behavior  up  to  the  No th  term.   Most  of 
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the  results  of  this  dissertation  are  equally  applicable  to  discrete- 
time  systems,  but  are  developed  here  in  the  context  of  continuous-time 
systems  only.  .. 

Two  interesting  and  important  variants  of  the  partial  realization 
problem  are  defined  and  discussed  in  the  next  chapter.   These  are  the 
minimal  partial  stable  realization  and  the  minimal  partial  arbitrary 
realization  problems. 

The  approach  taken  in  the  next  sections  is  to  analyze  the  basic 
properties  of  all  minimal  factorizations  of  the  form  (2.4a)  and  (2.5a) 
for  infinite  and  finite  matrix  sequences,  respectively,  and  use  such 
information  to  formulate  simple  realization  algorithms.   The  ideas  and 
concepts  developed  in  this  chapter  also  extend  to  the  problems  discussed 
in  Chapter  3. 

Some  Definitions  and  Known  Results 
Several  definitions  and  well-known  results  which  provide  a  basis 
for  the  main  results  of  this  chapter  are  stated  below. 
(2.7)   Definition.   The  generalized  Hankel  matrix  3f  of  an  infinite 

sequence  {L^.L^,...}  is  defined  as  the  following 
infinite-dimensional  matrix 


h    h        S 
4    S    h 


5f  = 


h   \        L5 


and  the  jth  column  of  the  kth  block  column  of  K 
is  denoted  by  h.^.      Also,  Z.^   is  defined  to  be  the 
jth  column  of  Lj^. 
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(2.8)   Definition. 


The  generalized  truncated  Hankel  matrix  Tf,.,,  of 

NN 

an  infinite  sequence  {L   L„,...l  is  defined  as 
the  following  mNxrN'  matrix 


^NN'  ~ 


h    s 


S-I  \ 


^N'-l    ^N' 


S+N'-3  ^N+N'-2 
^N+N'-2  S+N'-l 


and  its  (r(k-l)+j)th  column  is  also  denoted  by 

h.,  .      Whether  h.,     is  an  infinite  vector  or  not 
-jk  -jk 

will  be  made  clear  from  the  context. 
The  following  fundamental  result  of  realization  theory  is  stated 
witliout  proof  (see  Kalman  et  al.  ,  1969,  for  the  proof), 
(2.9)   Theorem.   (Realizability  Criterion)  Consider  an  infinite  se- 
quence {L  ,L„,...}  of  mxr  matrices  which  admits  a 
finite-dimensional  realization.   System  (2.1)  is  a 
minimal  realization  of  the  given  sequence  if  and 
only  if 


(2.10) 


P(%')  =  P(ViN'+3> 


i  =  0,1,2,... 
j  =  0,1,2,... 


for  some  integers  N  and  N' .   The  dimension  of  the 
minimal  realization  is  given  by  p   =  p  (7f   , )  . 
This  theorem  implies  that  the  columns  (rows)  of  3<"  after  the  rN'th 
(mNth)  column  (row)  are  linearly  dependent  upon  the  preceding  columns 
(rows).   It  is  shown  below  that  this  linear  dependency  occurs  in  a  re- 
cursive fashion  (that  is,  the  coefficients  by  which  the  (rN'+j)th 
column  for  j  =  l,2,...,r,  depends  on  its  preceding  rN'  columns  are  the 
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s.imo  coefficients  by  which  the  (rN'+j+k)th  column  for  k  =  1,2,..., 
cJciicnds  on  its  preceding  rN'  columns).   Generally,  these  linear  di- 
priidcnc  ifs  i-.in  lie  dcfintnl  bv  mor(>  tlian  one  set  of  coef  f  i  i- i  en  t  s  (dcpciiil- 
Lnj;  on  which  specific  basis  is  chosen),  but  among  all  the  possible  sets 
there  is  one  that  has  a  direct  relation  with  the  basic  input  (output) 
structure  of  a  minimal  realization  (2.1)  of  the  sequence.   It  is  this 
the  set  of  coefficients  which  is  sought  here. 

Given  a  system  of  the  form  (2.1),  its  impulse  response  sequence 
can  be  generated  using  (2.2)  or  (2.3).   In  the  minimal  partial  realiza- 
tion problem  it  is  required  that  the  first  No  terms  of  the  impulse  re- 
sponse sequence  of  a  realization  match  exactly  the  specified  partial  se- 
(|\ience.   This  suggests  the  following  solution.   Append  to  the  given  par- 
tial sequence  an  extension  sequence  {L.,  ,,  L.,  ,„,...}  and  then  solve 

No  +1  ,  Nn  +Z 

the  realization  problem  using  any  one  of  several  realization  schemes 

(for  example, Ho  and  Kalman,  1966;  Rissanen,  1971;  Ackermann  and  Bucy, 

1971;  Silverman,  1971).   However,  one  has  to  be  cautious  in  selecting 

an  extension  sequence.   A  poorly  chosen  extension  sequence  can  lead  to 

a  high-dimension  (possibly  infinite)  realization. 

Consider  a  partial  sequence  (L,,L„,...,L   }  of  mxr  matrices,  and 

1   z       No 

form  the  associated  Hankel  matrix  't(   as  follows. 
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(2.11) 


K  = 


No-1  \, 


T       * 


*    * 


V-1  ^No 


^No 


where  the  asterisks  (*)  represent  the  (as  yet  unspecified)elements  of 

an  extension  sequence,  and  7f     is  the  mNoxrNo  upper  left-hand  block 

No  No 

of  7f.   Suppose  that  the  unspecified  elements  in  (2.11)  are  chosen  such 
that  a  column  (row)  of  Jf  which  is  linearly  dependent  upon  its  preceding 
columns  (rows)  before  the  specification  of  the  extension  sequence,  re- 
mains linearly  dependent  upon  its  preceding  columns  (rows)  after  the 
specification  of  the  extension  sequence.   It  is  clear  that  replacing 
the  asterisks  in  (2.11)  with  such  an  extension  sequence  cannot  increase 
the  rank  of  If.   Then,  if  such  a  selection  of  the  unspecified  elements 
can  indeed  be  made,  it  follows  from  Theorem  (2.9)  that 


(2.12) 
where 


p^  =  p(50  =  p(.K,_^,   )   =  p,  +  p„  +  ...  +  p 


M 


No  No 


1 


^No 


p   =  number  of  linearly  independent  columns  in  the  block 
column 


No 
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p   =  number  of  linearly  independent  colunins  in  Lite  hloek 


col umn 


that  are  also  linearly  independent  of  the  columns  in 
the  block  column 


L 


%-l 


p^,   =  number  of  linearly  independent  columns  in  the 

No 

matrix  L    that  are  also  linearly  independent 

No 

of  the  columns  of  the  matrices  L,  ,!.„,...  ,L--   ,. 

i   Z      No  - 1 

Kalman  (1971b)  and  Tether  (1970)  have  independently  shown  that  an 
extension  sequence  always  exists  for  which  the  dimension  of  the  realiza- 
tion is  given  by  p  ,  and  that  (generally)  it  is  not  unique.   An  extension 
sequence  which  corresponds  to  a  minimal  realization  (that  is,  a  realiza- 
tion of  dimension  p  )  is  said  to  be  a  minimal  extension  sequence.   This 
result  is  now  stated  as  a  theorem, 

(2.13)   Theorem.   Given  a  finite  sequence  (l  ,L  , ...,L   1  of  mxr 

I       Z  No 

matrices,  the  dimension  of  its  minimal  realization 
is  given  by  (2.12). 
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The  proof  of  Tlieorem  (2.13)  appears  in  the  work  of  Kalman  (197Ui) 
and  of  Tether  (1970),  and  is  not  repeated   here.   Tt  consists  oi'   ,i  svs- 
Li'MiaLir  procedure  for  selecting;  the  columns  (rows)  ol'  thi.'  mat  rices  in 
the  extension  sequence  so  that  existing  linear  dependencies  in  3f  are  not 
disturbed.   In  the  process,  it  becomes  apparent  that  there  will  generally 
be  some  arbitrariness  involved  in  the  selection  of  an  extension  sequence 
which  does  not  increase  the  rank  of  3f  from  the  value  p  .   That  is,  the 
minimal  extension  sequence  is  generally  not  unique.   This  nonuniqueness 
can  conceivably  be  used  to  obtain  a  minimal  realization  with  some  de- 
sirable characteristics  (for  example:  cyclicity,  as  many  stable  poles  as 
possible,  and  others).   Unfortunately,  the  construction  used  by  Kalman 
(1971b)  and  Tether  (1970)  does  not  give  much  insight  for  doing  so  be- 
cause the  number  and  nature  of  the  allowable  degrees  of  freedom  is  not 
easily  recognized  (except  in  the  scalar  case).   Godbole  (1972)  has 
pointed  out  some  of  these  problems  via  examples. 

Consider  now  the  following  remarks. 

(2.14)  Remark.   It  is  clear  that  the  integers  N,  N' ,  p  ,  p  ,  ...,  p 

M    1  No 

are  non-decreasing  functions  of  No,  and  should  be  written  as  N(No), 
N' (No ) ,  p  (No ) ,  etc.   However,  to  maintain  notational  simplicity  the 
argument  No  is  not  used  in  this  dissertation.  V 

(2.15)  Remark.   Equation  (2.12)  can  be  written  also  from  the  dual  point 
of  view.   That  is,  the  linearly  independent  rows  of  3C,  »,   can  be  con- 
sidered  instead  of  its  columns,  and  the  resulting  p   is  the  same  value 

as  that  calculated  using  (2.12).  V 

(2.16)  Remark.   In  the  complete  realization  context,  a  minimal  realiza- 
tion is  both  completely  controllable  and  observable  (otherwise,  pole- 
zero  cancellation  in  the  transfer  function  matrix  would  reduce  the 
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dimension  of  the  realization),  and  vice  versa,  a  completely  controllable 
and  observable  realization  of  an  infinite  matrix  sequence  is  also  niiiii- 
iiiil  (lliis  is  a  (■iinsi'(|ii('ni'('  of  the  tin  i  f|ii('iu'ss ,  inodiiin  a  h.isis  cliaiij'.c  in 
tile  State-space,  of  complete  realizations).   However,  while  it  is  still 
true  in  the  partial  realization  context  that  minimality  implies  complete 
controllability  and  observability,  it  is  not  always  true  that  a  completely 
controllable  and  observable  realization  of  a  partial  sequence  is  also 
minimal.   This  is  a  consequence  of  the  nonuniqueness  of  partial  realiza- 
tions.  A  more  detailed  discussion  of  the  nonuniqueness  of  partial  re- 
alizations is  given  at  the  end  of  this  chapter  and  in  the  next  chapter.  V 

In  all  the  above  discussions  and  in  the  above  remark,  the  consid- 
eration of  infinite  and  finite  sequences  all  of  whose  elements  are  zero 
(referred  to  as  null  or  zero  sequences)  has  been  implicitly  ruled  out. 
This  is  so  because  the  dimension  of  the  minimal  realization  of  a  null 
sequence  (both  partial  and  complete)  is  equal  to  zero,  and  such  a  re- 
alization is  not  of  the  form  (2.1). 

Non-minimal  realizations  of  an  infinite  null  sequence  are  trivially 
given  by  any  completely  uncontrollable  and/or  unobservable  system  of 
the  form  (2.1),  but  such  realizations  are  not  very  meaningful.   In  con- 
trast, it  is  possible  to  construct  completely  controllable  and  obser- 
vable non-minimal  realizations  for  a  finite  null  sequence,  and  it  can 
be  shown  (based  on  the  theory  presented  in  Chapter  3)  that  such  realiza- 
tions have  arbitrary  structure  and  poles.   But  in  the  application  of 
partial  realization  theory  to  observer  design  (which  is  one  of  the  main 
objectives  of  this  dissertation)  the  occurrence  of  a  partial  null  se- 
quence has  a  trivial  interpretation.   For  these  reasons,  it  is  assumed 
that  all  sequences  (whether  partial  or  complete)  considered  in  this 
dissertation  are  non-zero  unless  stated  otherwise. 
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Realization  Invariants  and  a  Canonical  Form 
Tlu'  basic  properties  common  to  all  minimal  factorizations  of  the 
loriii  (;'!.'i.i)  ,111(1  {2.''):\)     lor  inliniLc  .iinl  finite  matrix  sr(|iiences,  re- 
spectively, are  studied  next.   This  leads  to  the  definition  of  a  com- 
plete system  of  invariants  for  minimal  complete  and  partial  realizations, 
and  the  construction  of  a  set  of  state-space  canonical  forms.   The  matrix- 
fraction  description  of  system  (2.1)  (which  is  becoming  quite  popular  in 
the  current  literature)  is  also  considered  briefly,  and  a  relation  be- 
tween the  set  of  state-space  canonical  forms  and  a  corresponding  matrix- 
fraction  description  is  presented.   These  results  are  the  basis  for  the 
minimal  realization  algorithms  of  the  next  section  and  Chapter  3. 
Consider  first  the  following  definitions. 

(2.17)  Definition.   The  controllability  index  of  a  completely  con- 

trollable matrix  pair  (A,Q)   is  defined  as  the 
smallest  positive  integer  y  such  that  the  matrix 

C  =  [Q   AQ   ...   A^"^Q] 
has  rank  p. 

(2.18)  Definition.   The  observability  Index  of  a  completely  observable 

matrix  pair  (A,D)   is  defined  as  the  smallest 
P 

positive  integer  6  such  that  the  matrix 

"d 


0   = 


DA 


DA 


6-1 


has  rank  p. 
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(2.19)  Definition.   Let  £.  denote  the  ith  column  of  Q.   Select  the 

first  p  linearly  independent  columns  of  C   and 
rearrange  them  as  follows 

(2.20)  ^^,  A^^,  ...,  A    ^^,   ^^,    ...,    A  £2' 

V   -1 
•  •  • .  5.^ .  . .  .  ,  A    3^^ 

The  integer  y.  which  denotes  the  number  of  columns 
of  C   in  the  above  basis  that  are  associated  with  ^^ 
is  called  the  ith  controllability  index  of  the  ma- 
trix pair  (A,Q)  ,  and  the  set  of  integers  {y^}  is 
called  the  set  of  controllability  indices  of  the 
pair  (A,Q)  .   The  dual  set  of  observability  indices 
{6.}  of  the  matrix  pair  (A,D)   is  defined  analo- 
gously by  considering  the  first  p  linearly  indepen- 
dent  rows  of  0.      It  is  clear  that  the  {y.}  and  {6  } 
are  well-defined,  unique  sets  of  positive  (given 
p(Q)  =  r  and  p(D)  =  m)  integers,  and  that 

p  =  y^  +  y2  +•••+  y^.  "  "^1  "^  "^2  "'"••*"''  "^m 

y  =  max(y.) 
6  =  max ( 6 . ) 
By  a  slight  abuse  of  notation,  the  {y.}  and  {6.} 
are  also  called  the  controllability  (or  input)  and 
observability  (or  output)  indices,  respectively, 
of  system  (2.1). 
The  integers  {y.}  are  also  referred  to  as  the  Kronecker  or  minimal 
indices  of  a  matrix  pair  (A,Q)   because  of  their  relation  to  the  minimal 
indices  of  the  matrix  pencil  [si  -  A   Q] .   A  dual  remark  holds  for  the 
integers  {6  }.  This  relation  has  been  discussed  by  Rosenbrock  (1970)  and 
Kalman  (1971a). 
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The  following  lemma  is  basic  to  all  the  developments  of  this  chap- 
ter.  It  seems  to  have  appeared  first  in  a  paper  by  Rissanen  (1974), 
and  more  recently,  it  appears  mentioned  in  the  work  of  Dc^nham  (I9//4), 
Dickinson  et  al.  (1974a,  b) ,  and  Akaike  (1974).  Roman  and  Bullock  (l<r)7'j) 
have  derived  it  independently,  and  that  approach  is  the  one  followed 
here. 

(2.21)   Lemma.   Consider  an  infinite  sequence  {L  ,L   . . . }  of  mxr 

matrices  which  admits  a  finite-dimensional  minimal 
realization  (2.1),  and  let  Jf  be  the  associated  Hankel 
matrix.   Then  the  columns  of  3C  satisfy  the  following 
recurrence  relations 


(2.22) 


(2.23) 


o. . 
^        12 


1  j  =  lk=l    -JJ 


=  1,2,. ..,r 
T  =  0,1,2,... 


where  the  (Y-.,}  are  real  scalars,  the  {p.}  are  the 

controllability  indices  of  the  matrix  pair  (A,Q)  ,  and 

P 

the  {o . . }  are  given  by 


y.  +  1 

1 


o. .   =  <  y. 


for  y.  <  u. ,  i  >  j 
for  y^  <  y  ,  i  <  j 


y. 


for  y^  >  y^,  Vi,  j 

Proof.   Define  C   and  0   as  the  following  infinite  matrices 


(2.24) 


C  =  [Q  AQ   A^Q  .  .  . ] 

"d 


(2.25) 


0   = 


DA 


DA 
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I'hcn  matrices  ('   and  0   defined  previously  are  pxpp  and  iSpxp  subniat  rices 
of   I'   and  (',  respectively. 

System  (2.1)  is  a  minimal  realization  of  the  given  sequence,  so 
(A,Q)   and  (A,D)   are  a  completely  controllable  and  observable  pair, 
respectively.   Thus,  there  are  exactly  p  linearly  independent  columns 
in  C   and  in  0.      Select  a  basis  for  the  p-dimensional  space  from  the 
columns  of  C   using  the  selection  procedure  of  Definition  (2.19).   This 

identifies  the  controllability  indices  of  (A,Q)  . 

P 

From  the  procedure  used  to  select  the  basis  (2.20),  it  follows  that 

"i 
A  ^^,  for  1  i^  1  <  r,  can  be  expressed  as  a  linear  combination  of  those 

vectors  in  (2.20)  which  precede  it  in  C.      More  specifically,  A  ^£.  is  a 

linear  combination  of  the  vectors 

M.-l 

a.,  A^.,  ....  A      ^. 

ti.-l 

£j,  A£_.  ,  .  .  .  ,  A    £  for  M.  ^  p.  and  i  <  j 

(2.26)  y.  ^    ^ 

-9.-!  '  ^S.i  >    •  •  •  ,  A  £  for  y .  <  y .  and  i  •  j 

J     J  J  1    J         " 

£.,  A£.,  ....  A^'j'^^  f"^  ^iit^j  and  i  /  j 

whore  both  i  and  j  range  from  1  to  r.   Notice  that  the  exponent  of  the 
largest  power  of  A  in  (2.26)  is  given  by  a . .  -  1,  with  a  .  defined  as 
in  (2.23). 

^i 
The  dependency  of  A  £^  on  the  vectors  listed  in  (2.26)  can  be 

expressed  in  equation  form  as 

^i         ^  ""ij 
(2.27)         A^.  =  -   y   y  V  .A^-^n  i=  1.2,. ..,r 


j  =  l  k=l   ^J*^     J 


where  the  (y.  ..  }  are  well-defined,  unique,  real  scalars,  and  the  (o   } 

•^  ij 

are  as  in  (2.23).   From  (2.27)  it  follows  that 
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li.+T        r  "ij 

j  =  l  k=l   ^J'^      ^-1  '  ' 

I  =  0,1,2,... 
In  words,  (2.28)  states  that  the  columns  of  C   satisfy  a  set  of  r  recur- 
rence relations  with  coefficients  {y    } 

Since  p(C)    =   p(0)    =  p(30  =  p,  it  follows  that  the  vectors 

y  -1 

•  •  •  .  %r ,  .  . . ,  OA  "^  5.^ 
constitute  a  basis  for  the  n-dimensional  space;  further. 


y.+T        r  '^ij 
(2-30)         OA  ^   a.  =  -   Y    S     ^        .,. _        1  =  12 


j  =  l  k=l   ^J*"        J 


,r 


T  =  0,1,2,... 

Finally,  (2.22)  follows  from  (2.30)  and  the  definition  of  h         (see 

-jk 
Definition  (2.7)). 

(2.31)   Corollary.   The  columns  of  the  matrix  elemtnts  in  the  infinite 

impulse  response  sequence  {Lj^.L^,...}  of  system 

(2.1)  satisfy  the  following  recurrence  relations 

a.  . 

''■'''  V^-  =  -  ji  Ji  ^iJkVx  ^  =  ^2,...,r 

r  =  0,1,2,... 
where  the  {p.},  (y.^j^}.  and  the  {o .  .  }  are  as  pre- 
viously defined. 

Proof.   It  follows  from  (2.30),  the  definition  of  Z.,,    and  the  Hankel 
pattern. 

(2.33)   Remark.   Lemma  (2.21),  Corollary  (2.31),  and  most  of  the  result: 
that  are  given  here  can  also  be  stated  from  the  dual  point  of  view. 
This  is  done  by  considering  the  rows  of  0   and  JC  instead  of  the  columns 
of  C   and  K.      For  certain  purposes  (to  be  seen  later  on),  the  dual 
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approach  proves  to  be  more  convenient.   In  the  dual  context,  the  counter- 
parts of  the  parameters  (y^.^)  and  (a^  }  are  denoted  by  the  sets  (O..^,} 
and  {k..},  respectively. 

A  close  examination  of  Corollary  (2.31)  suggests  that  the  parame- 


t 


ers  {y.},  iy..,),    and  the  vectors  U.,}  for  i,  j  =  1,2,. ..,r  and  k  =  1, 
1     ij  k.  J  K 

2, . . . ,^. . ,    constitute  all  the  information  necessary  to  completely  spe- 
cify an  infinite  sequence  {L  ,L„,...}  which  admits  a  finite-dimensional 
realization  of  dimension  p.   This  point  can  be  discussed  more  precisely 
after  the  introduction  of  several  standard  definitions  (see,  for  example, 
MacLanc   andBirkhoff,  1967). 
(2.3A)   Definition.   A  group  is  a  set  of  elements,  denoted  by  G,  which 

is  closed  under  a  binary  operation,  denoted  by  °, 

such  that 

a)  the  operation  °    is  associative: 

xa(yaz)    =  (xoij)az  V  X,i/,Z  £  G 

b)  G  contains  an  identity  element  e: 

X°2.  =   Z°X   =    X  VXSG 

c)  G  contains  an  inverse  for  every  element: 

X°X~  =    X~   °x  =    C  V  X  G  G 

The  group  (G,n)  is  denoted  by  G  alone  when  the  asso- 
ciated operation  «  is  understood. 
(2.35)   Definition.   A  binary  relation,  denoted  by  ^^  on  a  set  S  is 

said  to  be  an  equivalence  relation  if  it  has  the 
properties  of 

a)  reflexivity:  X  "^  X  V  X  ^  S 

b)  synmietry:  X  '^  tj   implies  (/  '\-  X  V  X,  [/  S  S 

c)  transitivity:  X  '^  ij   and  t/  ''^  z  imply  X  -^  y 

V  X,i},Z   6  S 
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The  set  E(x)  =  {(/  :  t/  G  S  and  (/  -^^  x}   is  called 
the  equivalence  class  of  X. 

(2.36)  Definition.   A  function  f:S  ->  W,  where  S  and  W  are  sets,  is  an 

invariant  for  the  equivalence  relation  ^   ii   x  '^   i/ 
implies  f(x)  =  f(t/)  for  x,(/  e  5.   The  function  f 
is  a  complete  invariant  for  '^^  if  X  "^  ij   implies 
f(x)  =  f((/),  and  f(x)  =  f(t/)  implies  X'\' y .      A 
list  f  ,f   ...,f.  of  functions  f.:S  ^  W.  is  a 
complete  system  of  invariants  for  '^^  when  each 
f^  is  an  invariant  for  '^,    and  f ,  (x)  =  f,((/), 
t^{x)    =    f^Uj),    ...,  f.(x)  =  f.(ij)    imply  X  '^  y. 

(2.37)  Definition.   A  subset  P  of  a  set  S  is  a  set  of  canonical  forms 

for  the  equivalence  relation  ^'  if  to  each  subset 
E(x)  of  S  there  corresponds  exactly  one  element  d 
in  V;    this  element  d   is  then  the  canonical  form  of 
every  element  y   in  E(x). 
The  following  lemma  can  be  stated.   The  proof  is  simple,  and  is  not 
given;  it  consists  of  verifying  the  postulates  of  Definition  (2.34). 

(2.38)  Lemma.   The  set  all  pxp  nonsingular  matrices,  denoted  by  T, 

together  with  the  matrix  multiplication  operation,  de- 
noted by  *,  forms  a  group. 

(2.39)  Definition.   The  group  (T,-)  of  Lemma  (2.38)  is  called  the  gene- 

ral linear  group,  and  is  denoted  as  GL(p).   The  set 
of  all  controllable  and  observable  matrix  triples 
(A,Q,D)   is  denoted  by  S(p). 
The  set  5(p)  and  the  group  GL(p)  are  the  entities  of  interest  in 
this  dissertation.   An  equivalence  relation  is  defined  next  for  the  ele- 
ments of  S(p)  under  the  action  of  GL(p).   Then  a  complete  system  of 
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invariants  is  obtained  for  that  equivalence  relation,  and  a  subset  of 
S(p)    of  canonical  forms  is  defined.   This  leads  to  the  formulation  of 
simple  rc.alLzation  algorithms  to  solve  the  re.,  1  i /...  t  i.,,,  problems  pr..vio„s- 
ly  defined.   The  following  simple  lemmas  are  useful. 

(2.40)   Lemma.   A  change  of  basis  on  the  state-space  of  (2.1)  corre- 
sponds to  an  equivalence  relation  defined  by  GL(p) 
acting  on  5(p)  as  follows: 

for  any  T  in  GL(p) . 
Proof.   It  is  required  that  the  postulates  of  Definition  (2.35)  be  sat- 
isfied.  Reflexivity  is  shown  by  considering  T  =  I   in  (2.41).   Symmetry 

_i  P 

follows  using  T   : 

^^2''^2'°2>p^  (T-^A^T.T-^Q^.D^T)^  = 

(T-^TA^T-^T,T-^TQ^.D^T-lT)p  =  (A^.Q^.D^)^ 
To  show  transitivity,  let 


(A3,Q3,D3,^K  (T^AjT-'.T^Q^.D^T-')^  -  (A^.Q^.B^)^ 
and  take  T  =  T^T^  in  (2.41). 

(2.42)   Lemma.   Two  elements  of  5(p)  that  are  equivalent  under  the  action 

of  GL(p)  have  the  same  impulse  response  sequence. 
Proof.   Suppose  (A^.QpD^)^  and  (A^,Q2,Dp^   in  5(p)  are  equivalent.   Let 
the  impulse  response  sequence  of  (Aj,Q^,Dp   be  given  by 

h-^A~\  i=  1.2,... 

Then  it  follows  from  (2.41)  that 

V2"S  =  (^T-S(TAjT-^)i-VTQj)  i  =  1,2.... 

=   'l4~\    =L.t  i=    1.2,... 

as    required. 
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(2.43)   Lemma.   Any  two  minimal  realizations  of  an  infinite  matrix 

sequence  (l  ,L   . ..}  are  equivalent  under  the  action 
of  GL(p), 
Proof.   Let  Jf  be  the  Hankel  matrix  associated  with  a  specified  infinite 
trix  sequence  {l^,L^, . . .}   which  admits  a  minimal  realization  of  di- 
nsion  p,  and  let  (A^,Q^,D^)   and  (A2,Q2,D2)   be  two  such  minimal  real- 
izations.  The  Hankel  pattern  implies  that 


ma 


me. 


(2.44) 


,7f  = 


D. 
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D.A. 
1  1 

D.a2 
1  1 


[Q.   A.Q.   AtQ. 
1    11    11 


O.C. 
1  1 


i  =  1,2 


Let  0^    be  the  mpxp  top  submatrix  of  0.,    and  C.    be  the  pxrp  left 

submatrix  of  C^.      Since  a  minimal  realization  of  the  given  sequence  has 

dimension  p,  then  p(K)    =  p(,7f  )  =  p.   Both  realizations  (1  and  2)  are 

minimal,  so  p(0  )  =  p(5  )  =  p(C.)  =  p(C'.)  =  p.   Further,  0^.0     and  C  c'^ 
■'-■'-11  iiii 

are  nonsingular.   From  (2.44), 

(2.45)  O^C^  =  O^C^ 

and  using  the  fact  that  0  0      is  nonsingular, 

(2.46) 


^2  =  ^^2^2^  ^2^lS  =  T^l 


where  T  is  pxp.   That  T  is  nonsingular  can  be  shown  by  applying  Sylves- 
ter's rank  inequality  (see,  for  example,  Gantmacher,  1959).   Further 
manipulations  on  (2,46)  give 
(2.47)  I  =  TC^cl(C^cl)-^   =  TT"^ 
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From    (2.4A)    and    (2.46)    it    follows    th.it    Q      =    TO    ,    ..nd 

IA2Q2   A2\    ...    aPq^I    =   ITA^Q^    TaJq^    ...    TA^Q^I 


^2^   =   T^^l 


A2  =  TA^CjC^CC^C^)  ^  =  TA^t"^ 
The  "dual"  of  (2.46)  can  also  be  obtained  from  (2.45).  This  is 

It  follows  that  D„  =  D  T~  . 

The  preceding  developments  led  to  an  important  result  on  invari- 
ants for  GL(p)  acting  on  5(p).   it  „as  probably  obtained  first  by 
Rosenbrock  (1970)  via  a  frequency  domain  approach.   Rosenbrock's  deri- 
vation consists  of  performing  a  succession  of  equivalence  transforma- 
tions on  the  system  matrix,  which  is  defined  to  be  the  following  (p+m)x 
(p+r)  polynomial  matrix 

si  -  A       Q 

D       0 

m,r_ 

in  order  to  obtain  a  canonical  representation.   More  recently,  Rissanen 
(1974)  obtained  the  same  result  via  both  the  time  domain  (state-space) 
and  frequency  domain  points  of  view. 
(2.49)   Theorem.   The  parameters  {,.}  and  (y    },  and  the  vectors  {I      } 

for  i,j  =  1,2,. ..,r  and  k  =  1,2,. ..,a..,  with  a 

iJ        ij 
defined  by  (2.23),  constitute  a  complete  system  of 

invariants  for  the  equivalence  relation  defined  by 
the  action  of  GL(p)  on  5(p)."^ 


ere.  values  (see  Z\.llZ:\r.lr:.7Z':^r.72^2T°'''•   ""  "- 
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Proof.   First  it  has  to  be  shown  that  two  elements  of  S(p)  which  are 
('(|ii  i  vaU'iit  under  the  action  of  ni,(p)  have  the  same  sets  of  fu.'  'HkI 
(7..,  I  i)arameters  and  {H   ,  \    vectors.   Then  it  must  be  proved  that  two 
elements  of  S(p)  which  have  the  same  sets  of  the  above-mentioned  invari- 
ants are  related  to  each  other  as  in  (2.41). 

Consider  two  equivalent  elements  (A,,Q,,D,)   and  (A„,Q„,D„)   of 

iiip       Z      Z      Z   p 

5(p).   Lemma  (2.42)  states  that  they  have  the  same  impulse  response 

sequence  {L,,L„,...}.   Since  the  vectors  {£.,  }  are  columns  of  the  Im- 
12  -jk 

pulse  response  matrices,  it  follows  that  they  are  indeed  invariants  for 
GL(p)  acting  on  5(p). 

Given  the  Hankel  matrix  3^  of  an  infinite  matrix  sequence  which  ad- 
mits a  realization  of  dimension  p,  the  integers  {y.}  are  defined  by  the 
indices  associated  with  the  basis  formed  by  the  first  p  linearly  inde- 
pendent columns  of  7f  (the  basis  (2.29)).   This  identifies  the  {y.} 
uniquely.   The  real  scalars  {y . .,}   are  defined  by  equations  (2.30). 
Since  the  representation  of  a  vector  in  terms  of  a  basis  is  unique,  it 

follows  that  the  {y .  .,  )    are  unique  also.   Thus,  the  parameters  {u.}  and 

ijk  ^  5      r  --^ 


(y..,  } 


.   }  are  invariants  for  GL(p)  acting  on  S(p) 


To  prove  the  second  part,  suppose  now  that  two  elements  (A  ,Q  ,D  ) 
and  (A„,Q  ,D„)   of  S(p)  have  the  same  sets  of  the  above-mentioned  invari- 
ants.  The  impulse  response  sequences  of  (A  ,Q  ,D.)   and  (A  ,Q  ,D_)   can 
be  constructed  using  (2.32).   Obviously,  the  infinite  sequences  will 

be  equal  to  each  other.   It  follows  from  Lemma  (2.43)  that  (A, ,Q,,D,) 

i   1   1  p 

and(A^,Q  ,D  )   are  equivalent  under  the  action  of  GL(p).  V 

Popov  (1972)  has  discussed  the  invariant  problem  for  the  set  of  all 

matrix  pairs  (A,Q)   (which  represent  system  defined  by  (2.1a)  only) 

under  the  action  of  GL(p),  and  showed  that  the  {u.}  and  {y  ,  }  are  the 

1        'ijk 
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corresponding  invariants.   This  result  is  also  contained  (indirect  ly  )in 
the  work  of  Kalman  (1971a). 

(2.50)  Remark.   The  number  of  the  (y..,)  invariants  depends  on  the  value 

and  ordering  of  the  {y  }  invariants.   Given  a  specified  set  of  the  (u  I 

1  i  ' 

the  number  of  iy^.^^}    invariants  associated  with  the  same  matrix  triple 
is  obtained  as 

(2.51)  a  =  lo  =  ^  la.. 

i=l     i=l  j=l  ^J 

where  the  {a. J  are  defined  by  (2.23).   Based  on  the  procedure  used  to 
compute  the  {y.},  and  examining  (2.22),  (2.27),  or  (2.32),  it  can  be 
shown  that  a  <  rp.   Further,  it  can  also  be  shown  (see  Popov,  1972) 
that  equality  occurs  if  and  only  if  y   =  y   =  . . .  =  p  ,  or  if  and  only 


j+1   ^j+2 


if  ^1  >  M2  =  •  •  •  i  \  ^  °  ^"^^  ^1  =  ^"2  "  •  •  •  =  ^^-  '  '^^ 

U   =  y,  -  1  for  some  0  <  j  £  r  -  1.  \ 

(2.52)  Remark.   Let  W^  be  the  set  of  all  r-dimensional  vectors,  W     be 

the  set  of  all  a-dimensional  vectors,  and  W  be  the  set  of  all  mp- 

dimensional  vectors.   Then,  in  terms  of  Definition  (2.36),  f,:5(p)  ^  W 

is  the  function  which  specifies  the  {y^}  for  a  given  matrix  triple, 

f2:S(p)  ->  W  is  the  function  which  specifies  the  {y  ,  }  for  a  given 

ijk        * 

matrix  triple,  and  f3:S(p)  ^  0/^  is  the  function  which  specifies  the 
{i.^}    for  a  given  matrix  triple.   The  closed  form  of  these  functions 
is  not  necessary  for  the  purposes  of  this  dissertation,  and  from  the 
procedures  used  to  compute  these  sets  of  invariants,  it  seems  that  f  , 
f^,    and  f^  are  not  simple  functions  of  the  elements  of  a  matrix  triple. 
The  first  part  of  the  proof  of  Theorem  (2.49)  consisted  of  demonstrating 
that  these  functions  (f^,f2.and  f3)  are.  individually,  invariants  for 
the  action  of  GL(p)  on  S(p).   However,  they  are  not  complete  invariants 
if  considered  individually. 
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(2.53)  Remark.   The  integer  p,  the  integer  O  defined  in  (2.51),  and 
the  set  of  integers  (o..)  are  also  invariants  for  GL(p)  acting  on  5(p). 
lliLs  is  also  true  of  the  dual  of  these  and  of  the  invariants  of  Theort-m 
(2.49).   But  for  the  purposes  of  this  dissertation,  it  seems  to  be  rnort 
convenient  to  use  the  system  of  invariants  of  Theorem  (2.49),  or  (in 
some  cases)  their  dual  counterparts.  V 

The  theorem  stated  below  gives  a  canonical  state-space  representa- 
tion for  the  equivalence  relation  defined  by  a  change  of  basis  in  the 
state-space  of  system  (2.1).   A  canonical  form  for  a  matrix  triple  can 
be  thought  of  as  a  "standard"  form  which  is  determined  exclusively  by 
a  complete  system  of  invariants  for  the  involved  equivalence  relation. 
Thus,  once  these  invariants  are  known,  the  canonical  form  is  also  known. 

Canonical  representations  are  very  useful  in  the  analysis  and  de- 
sign of  systems  because  they  display  in  a  conventient  format  the  struc- 
ture, dynamics,  and  other  important  information  about  the  system  which 
they  represent. 

(2.54)  Theorem.   Consider  an  infinite  sequence  {L   L„,...}  of  mxr 

matrices  which  admits  a  finite-dimensional  realiza- 
tion (2.1),  together  with  its  corresponding  parame- 
ters {y.}  and  (y..,)  as  in  (2.32).   Then,  the  repre- 
1        ij  k 

sentation  of  (2.1)  given  by 


(2.55a) 


A  = 


^11    ^12  • 
^21    ^22  • 


A  ,    A  , 
rl     r2 


Ir 


.  A 


2r 


rr 


'58 


(2.55h) 


(2.55c) 


(2.56a) 
(2.56b) 

(2.57a) 
(2.57b) 
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Q  =  [£^  q^       ...  ci^] 

y. 

1 

-jk   -jk 


^r   -■y^+...+y^_^+l 


.  d. 


..  .  d 
— 1 

J  = 
k  = 


1  • 


-rU. 


1,2, ...r 


1,2,... ,M. 


Is  a  canonical  state-space  representation. 
Proof.   Notice  that  the  size  of  all  the  submatrices  of  A  and  the  position 
of  unity  elements  in  the  A   submatrices  are  determined  exclusively  by 
the  values  of  the  parameters  (y  }.   The  A   submatrices  are  in  the  well- 
known  observable  canonical  form,  and  the  A^ .  submatrices  have  nonzero 

ij 

elements  only  in  the  last  column;  further,  these  last-column  elements 

are  either  given  by  the  negative  of  one  of  the  (y,  .,  }  scalars  or  zero. 

Thus,  A  is  completely  defined  by  the  {y,}  and  (y,  .,  }  invariants.  Simi- 

i        'ijk 
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l.itly,    ()    is    (U't  I'l  111  iiK'il    c'oiiiiilc'Li.' 1  y    hy    I  lu'    l|i.  I,    siiiic     i  I  s    only    ikhi/.cio 

flt'incnLs    iiave    unity   value,    and    their   positions    in    the    rolunins    ul    ■  i   ilr - 

IHMul    exclusively    on    the    values    of    the    (ji.).       The    columns    of    D   are    u,ruupeil 

in    "chains",    the    length   of   which   is   determined  by    the    size   of    the    i\..}, 

and    their   value    is   given  by    the    {£      }    vectors.      Thus,    the    triple    (A,L>,D) 

^K  p 

in  (2. 55)- (2. 57)  is  determined  completely  by  the  {u.},  (y..,),  and  {'l   ,  } 

1     ijk        -jk 

invariants.   Uniqueness  of  the  form  is  obvious. 

That  (A,Q,D)   as  above  generates  the  given  sequence  follows  by  com- 
puting the  products  (2.Aa)  and  applying  (2.32).  V 

A  system  (2.1)  which  is  represented  by  (2 . 55)- (2. 57)  "looks"  like 
a  cascade  of  single  input  subsystems  coupled  in  both  directions  by  the 
last  state  of  each  subsystem.   The  size  of  subsystem  i  is  y.,  and  its 
dynamics  are  given  in  the  roots  of  its  characteristic  polynomial: 

u.       y.-i 

It  should  be  noticed  that  unless  the  coupling  of  the  subsystems 

is  zero  (at  least  in  one  direction),  the  overall  system  dynamics  are 

not  given  (in  general)  by  the  roots  of  the  characteristic  polynomials 

of  the  r  subsystems.   However,  since  the  nonzero  elements  of  A  are  the 

(y...  }  invariants,  they  determine  the  overall  system  dynamics  exclusivel\'. 
ijk  -^  ■'  ■ 

Thus,  it  can  be  stated  that  the  (u.}  define  the  basic  structure  of  (2.1), 

and  the  {y...  }  determine  its  dynamics, 
ijk 

The  {^.,  ^  vector  invariants  represent  the  gains  through  which  Uie 
states  appear  at  the  outputs. 

(2.58)   Remark.   Certain  relations  exist  between  the  invariants  of 
Theorem  (2.49).   As  discussed  in  Remark  (2.50),  the  number  of  lY   ,  }  in- 
variants  is  determined  by  the  values  of  the  {y.}  invariants,  although 
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their  actual  values  do  not  depend  at  all  on  the  {y.l  invariants.   However, 

tlic  fy    \    and  {J  ,  \     invariants  are  related  to  each  otlier  in  the  .sfn:;e 
'ijk       -jk 

thai  (lie  observability  matrix  (2.18)  with  A  and  D  as  in  (2.55)  and  (2.5/), 
respectively,  must  have  full  rank  for  some  finite  6. 

The  above  ideas  are  implicitly  expressed  in  (2.22)  and  (2.32).  The 
integers  {o..}  (which  are  defined  by  the  {y.}  invariants  through  (2.23)) 
and  the  scalars  (y..,  )  determine  the  length  and  the  coefficients,  respec- 
tively,  of  these  two  sets  of  recurrence  relations,  while  the  vectors 
{£  ,  }  are  the  "initial  conditions"  for  these  recurrence  relations.  In 
other  words,  given  the  invariants  of  Theorem  (2.49),  the  infinite  im- 
pulse response  sequence  of  the  system  can  be  generated.  V 

The  state  space  representation  given  in  Theorem  (2.54)  has  an  appli- 
cation in  the  problem  of  identifying  the  parameters  of  a  system  for  both 
the  cases  of  deterministic  output  data  (discussed  subsequently  in  this 
chapter)  or  noisy  output  data  (Bonivento  et  al. ,  1973;  Akaike,  1974). 
The  result  of  Theorem  (2.54)  can  also  be  advantageously  applied  to  the 
design  of  minimal  order  observers  to  estimate  linear  functions  of  the 
state  of  a  system  (this  application  is  discussed  in  Chapter  4). 

Several  alternate  state-space  canonical  forms  can  be  defined  for 
S(p)  under  the  action  of  GL(p).   Every  canonical  form  has  its  own  char- 
acteristics and  is  useful  in  certain  applications.   An  extensive  discus- 
sion of  this  topic  and  a  list  of  the  most  relevant  references  appear 
in  a  recent  survey  paper  by  Denhara  (1974).   For  the  purposes  of  this 
work,  the  form  given  in  Theorem  (2.54)  seems  to  be  the  best  suited. 

There  is  an  alternate  representation  of  system  (2.1)  which  is  also 
of  some  interest  in  this  dissertation.   It  is  a  factorization  of  ^(s). 
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Llie  transfer  function  matrix  of  system  (2.1).   This  factorization  has 

the  form 

(2.59)         $(s)  =  f(s)r"^(s) 

where  the  polynomial  matrices  l'(s)  and  r(s)  are  mxr  and  rxr,  respectively. 

Such  a  factorization  of  $(s)  is  known  as  a  matrix-fraction  description 

of  system  (2.1),  and  has  been  used  extensively  in  the  analysis  and  design 

of  systems  (Popov,  1969;  Rosenbrock,  1970;  Wolovich,  1972a,  b,  1973a,  b; 

Wang  and  Davison,  1973;  Dickinson  et  al. ,  1974a,  b;  Rissanen,  1974). 

As  with  state-space  descriptions,  matrix-fraction  descriptions  are 
not  unique.   It  is  possible  to  define  an  equivalence  relation  on  the  set 
of  all  polynomial  matrix  pairs  (H'(s),r(s))  which  satisfy  certain  condi- 
tions, obtain  a  complete  system  of  invariants,  and  define  a  corresponding 
set  of  canonical  forms.   Popov  (1969),  Rosenbrock  (1970),  and  Dickinson 
et  al.  (1974b),  among  others,  have  investigated  this  problem  extensively, 
and  it  is  not  considered  here.   For  the  purposes  of  this  dissertation  it 
suffices  (and  seems  to  be  preferable)  only  to  be  able  to  relate  in  some 
simple  way  the  canonical  state-space  description  (2. 55)-(2. 57)  of  system 
(2.1)  with  a  matrix-fraction  description  (not  necessarily  canonical)  of 
(2.1).   However,  it  is  required  that  (H'(s),r(s))  be  an  irreducible  pair 
(that  'i'(s)  and  r(s)  have  no  non-trivial  polynomial  factors  in  common). 
This  is  the  same  thing  as  a  state-space  description  being  completely 
controllable  and  observable.   The  matrix-fraction  description  given  in 
the  following  theorem  satisfies  these  requirements. 

(2.60)  Theorem.  Consider  an  infinite  sequence  {l ^L^,-.-}  of  mxr  ma- 
trices which  admits  a  finite-dimensional  realization 
(2.1),  together  with  its  corresponding  parameters  {p^} 


A2 


(2.61) 


(2.62a) 


(2.62b) 


and  (y   ,  }  as  in  (2.32).   Then,  there  Is  a  matrix- 
fraction  description  of  (2.1)  with  H'(s)  and  ['{s) 


given  as 

r(s) 


=  r 


r(s)  = 


^,s^  +  r  s^-^  +  , 

Y2i(s)    Y22(s) 


Y^l(s)    Y^2(^> 


y.-i 

1 


+  r^s  +  r^ 


.   Y,  (s) 

Ir 

•  Yo  (s) 
2r 


Y   (s) 
rr 


Y,,(s)   =   s        +Y,,^_s  +   •••   +Yii2«+Yiil 


(2.62c) 


(2.63) 


(2.64) 


Y. . (s)    =   Y.  .         s 

J 


a.  -1  a. .-2 

J^        +Y..  ,s  J^        + 

1  la .  .  - 1 


+Y3i2^^^jil 


H'(s)   =  4*  s^~^  +  'F^    ,s^  ^  + 


U+l-i 

4'.  =     ^    L.r... 


+  H'^s  +  H'^ 


i  =    1,2,.  . .u 


This  matrix-fraction  description  is  irreducible. 

The  proof  of  the  above  theorem  is  omitted.   Equations  (2.61)  and 
(2.64)  are  easily  verified  by  writing  (2.59)  as  ^(s)    T (s)    =   ^(s),  sub- 
stituting (2.61)  and  (2.63)  for  r(s)  and  ^(s),  equating  powers  of  s  on 
both  sides,  and  finally  using  the  recursive  relations  (2.32).   But  to 
prove  that  r(s)  is  nonsingular  and  that  the  pair  (y(s),r(s))  is  irreduci- 
ble is  more  complicated  and  quite  lengthy. 

Rosenbrock  (1970)  gives  a  detailed  proof  from  a  computational 
point  of  view  starting  with  his  system  matrix  representation  in  the 
state-space  canonical  form  (2 . 55)-(2. 57) .   In  Rosenbrock's  work  the 


A3 


above  results  appear  in  a  slightly  different  form  (he  further  reduced 
l'(s)  to  lower-triangular  form  by  performing  column  operations  on  it; 
of  course,  the  same  column  operations  must  be  performed  on  ^(s)    also). 

If  the  controllability  indices  are  ordered  in  non-increasing  fashion 
(that  is,  y,  >  IJ2  2,  •••  ^  y  )>  then  the  matrix-fraction  description  of 
Theorem  (2.60)  is  a  canonical  matrix-fraction  description  (Popov,  1969; 
Dickinson  at  al. ,  1974b).  Ordering  the  controllability  indices  in  such 
a  way  corresponds  to  ordering  the  inputs.  However,  such  an  operation  is 
not  an  admissible  operation  for  equivalence  in  5(p)  under  the  action  of 
GL(p),  so  the  meaning  of  iy..-,)    and  i^.,}   as  Invariants  is  destroyed. 

IJK  JK 

A  new  system  of  invariants  would  have  to  be  defined.   This  is  due  to 
the  fact  that  the  group  which  determines  the  equivalence  relation  com- 
monly defined  on  the  set  of  polynomial  matrix  pairs  (H'(s),  r(s))  is  not 
GL(p)  (see  Popov,  1969;  Rosenbrock,  1970;  or  Dickinson  et  al. ,  1974a, b). 

Rissanen  (1974)  forces  T    ,,  to  be  nonsingular  and  obtains  a  cano- 

y+1  '^ 

nical  form  closely  related  to  the  form  described  in  Theorem  (2.60). 

However,  as  pointed  out  by  Dickinson  et  al.  (1974a, b),  this  condition 

is  unnecessary  and  (generally)  gives  a  reducible  form  for  the  pair 

(H'(s),r(s)). 

The  canonical  form  of  Theorem  (2.54)  is  related  in  a  simpler  fashion 

to  the  system  of  invariants  {y.},  {y .  .,  } ,    and  {l.,   }  than  the  matrix- 

1  '    ijk  '      -jk 

fraction  description  of  Theorem  (2.60).   Thus,  it  seems  reasonable  that 
(2. 55)-(2. 57)  would  be  a  more  useful  representation  of  (2,1)  than  (2.61)- 
(2.64)  for  most  applications.   This  indeed  turns  out  to  be  the  case  in 
the  minimal  complete  and  partial  realization  problems  and  in  the  prob- 
lems discussed  in  the  following  chapters.   Mostly  due  to  this,  the 
results  that  follow  are  developed  in  the  context  of  state-space 
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descriptions  only.   However,  since  the  results  are  obtained  in  terms 
ot  the  invariants  {y  },  (y..,),  and  U.,},  then,  in  view  of  (2.61)- 
(2.64),  a  matrix-fraction  description  is  also  practically  available. 

Minimal  Realization  Algorithms 
Lemma  (2.21),  Corollary  (2.31),  and  Theorems  (2.49),  (2.54)  pro- 
vide the  basis  for  an  attractive  solution  to  the  minimal  complete  and 
the  minimal  partial  realization  problems.   Such  a  solution  is  presented 
after  the  following  discussion. 

Recall  from  Definition  (2.4)  that  in  the  minimal  complete  realiza- 
tion problem  one  is  faced  with  the  prospect  of  examining  an  infinite 
amount  of  data.   Thus,  strictly  speaking,  the  minimal  complete  realiza- 
tion problem  can  never  actually  be  solved.   Fortunately,  the  problem 
can  be  proposed  in  a  more  ameanable  form  with  the  help  of  the  following 
definition. 

(2.65)   Definition.   Consider  an  infinite  sequence  (L  L  , . . .} of  mxr 

matrices.   A  matrix  triple  (A,Q,D)   is  said  to  be 

P 

a  minimal  realization  of  degree  No  of  the  given  se- 
quence if  and  only  if  (A,Q,D)   is  a  minimal  partial 

realization  of  {L,,L„...L„  }. 
12     No 

Now  the  minimal  realization  problem  can  be  considered  to  be  that 
of  obtaining  a  triple  (A.Q.D)^  which  satisfies  conditions  (2.5a)  and 
(2.5b)  as  No  is  increased.   The  best  way  to  solve  such  a  problem  seems 
to  be  one  which  is  recursive.   Here  recursive  means  that  as  No  is 


tStandard  usage  (Kalman  et  al.,  1969;  Kalman,  1971)  dictates  that  a 
realization  which  satisfies  (2.5a)  and  (2.5b)  is  one  of  order  No.  The 
above  change  in  nomenclature  is  Introduced  here  to  avoidT^^usion  in 
later  chapters  where  (in  the  context  of  observer  design)  order  of  a 
minimal  realization  refers  to  its  dimension. 
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increased  to  Nn ,  the  computations  used  to  obtain  the  triple  (A,Q,D) 

I 

which  realizes  the  given  sequence  up  to  the  No th  element  are  part  of  the 
computations  required  to  obtain  the  triple  (A,Q,D)  ,  which  realizes  tho 
given  sequence  up  to  the  Nj th  element.   Then  only  a  few  numbers  need  to 


l\l 


be  calculated  every  time  that  a  new  data  point  (an  L.  matrix)  forces  the 
dimension  of  the  minimal  realization  to  increase. 

Rissanen  (1971)  has  given  one  such  recursive  solution  in  the  state- 
space  representation.   His  algorithm  consists  of  a  special  factorization 
of  the  Hankel  array  ^f   ,  into  a  lower-triangular  matrix  L  that  has  I's 
in  the  main  diagonal,  and  another  matrix  U  which  is  in  a  special  form. 
This  factorization  allows  matrices  Q  and  D  to  be  obtained  by  inspection, 
and  matrix  A  is  obtained  by  inverting  a  lower-triangular  submatrix  of  L. 

As  new  data  is  added,  the  size  of  JC,»ti  increases,  and  so  does  the  size 

NN 

of  L  and  U.   However,  the  top  portion  of  matrices  L  and  U  is  available 
from  previous  computations,  so  only  the  bottom  elements  have  to  be  cal- 
culated.  Everytime  the  new  data  increases  the  rank  of  'K„,i  ,  a  new  re- 

NN 

alization  has  to  be  obtained.   But  due  to  the  factorization  procedure 

used,  the  matrices  of  the  previous  realizations  are  upper-left-hand 

corner  submatrices  of  the  new  realization.   Thus,  Rissanen' s  algorithm 

is  a  truly  recursive  procedure. 

The  algorithm  given  below  is  not  totally  recursive,  but  it  is 

shown  that  there  is  some  recursiveness  involved.   The  procedure  followed 

is  to  first  identify  the  invariants  {y.},  {y  ,  },  and  {Jl  ,  }  of  the  re- 

1  '    ijk  '      -jk 

alization  of  degree  No  .   Then  No  is  increased  to  No'  and  the  invariants 
of  the  realization  of  degree  Nj  are  identified.   Some  of  the  invariants 
do  not  change  as  the  minimal  realization  increases  in  size  due  to  the 
larger  number  of  impulse  sequence  terms  being  considered.   This  is  the 
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p.irlial  recursive  property  previously  mentioned.  Further,  since  the 
invariants  of  the  realization  are  identified,  the  algorithm  also  has 
the  convenient  feature  that  the  successive  realizations  are  obtained 
in  the  canonical  form  (2. 55)-(2. 57) . 

(2.66)  Minimal  Complete  Realization  Algorithm. 

Step  1.   Let  N  and  N'  be  the  smallest  integers  for  which  the  realiza- 

bility  criterion  (2.10)  is  satisfied  with  i  =  j  =  1.   That  is, 

(2.67)  PCK^^,)    =  P(\^,^,)    =  P(VlN'^  =  Pm 
Also,  define  No  =  N  +  N' . 

Step  2.   Consider  now  the  Hankel  array  'Cxit ,i-   Following  Definition 

(2.8),  denote  its  (r(k-l)+j)th  column  by  h.,.      For  notational 
simplicity,  assume  that  h^.    is  not  a  null  vector.   Starting 
with  _^^,,  examine  (in  order)  the  columns  of  'Cmi,!  for  linear 
dependence  upon  the  preceding  columns,  and  keep  the  linearly 
independent  ones  (including  ?2.  .) .   Take  the  selected  columns 
and  rearrange  their  order  so  that  the  second  subscript  varies 
the  fastest.   This  result  in  the  following  ordering 

(2.68)  h^^,    h^^,...,   h^^^,   ^21.  •■•.  ^2^2'  •••'  ^1'  •••'  -ru^ 

The  integers  {y.}  which  are  implicitly  defined  in  (2.68)  are 

the  controllability  indices  of  the  minimal  realization  of 

degree  No .   Let  L  be  a  full  rank  mNxp  matrix  whose  columns  are 

the  vectors  in  (2.68)  in  that  order.   Notice  that  p  ^   mN,  or 

else  the  selected  columns  are  not  linearly  independent.   Notice 

also  that  L  has  N  block  rows  of  p,,  block  elements  each,  and 

M 

these  block  elements  are  columns  of  the  matrices  in  the  given 
sequence. 
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(2.72) 


^n- 

hr 

'-ly. 

^31- 

'-n- 

hr 

^2- 

•••Aj,^+1 

'-a- 

hi' 

Step  3.   The  vectors  h  ^o  ,  . i »  • • • >  ^  ,  +i  ^re  linearly  dependent 

on  the  vectors  in  (2.68).  More  precisely,  due  to  the  selection 
procedure  used,  /z.  •  for  i  =  l,2,...,r,  is  linearly  dependent 
only  on  the  following  columns  of  L 


for  y.  <  y.  and  i  <  i 
1  =  J 

(2.69) 

for  y.  <  y.  and  i  >  i 
1    J 

for  y.  2^  y.  and  i  ?^  j 

where  j  =  l,2,...,r  also.   Notice  that  the  length  of  the  vector 
"chains"  in  (2.69)  is  determined  by  the  second  subscript  on 
the  vectors,  and  this  subscript  is  equal  to  a.,  calculated 
according  to  (2.23).   The  dependency  of  h^.         .  on  these  columns 
of  L  can  be  written  compactly  as 

(2.70)  K^  ^^   =  -LY.  i  =  l,2,...,r 

i 
where  the  hat  C^)  over  matrix  L  denotes  that  some  columns  of 

L  are  not  (generally)  included,  and  Y.  is  the  following  o .- 

dimensional  vector  (a.  is  as  defined  in  (2.51),  and  o.   ^  p  ) 

(2.71)  lj=  [Y,ii   Yii2   •••  ^ira.  ^  ^=  1,2,.. .,r 

ir 


Equation  (2.70)  is  now  solved  for  the  unknown  Y. •   This  gives 


1 


li  =  -^%.  +  l  ^=  1,2,.. .,r 

^      /v'p^  -l^T  " 

where  L"  =  (L  L)   L   is  the  (left)  pseudoinverse  of  L. 


Step  4.   A  minimal  realization  of  degree  No  of  the  given  sequence  is 

now  constructed  in  the  form  (2. 55)- (2. 57)  using  indices  {y.} 

identified  in  Step  2,  the  coefficients  {y..i  }  identified  in 

Step  3,  and  the  p   m-dimensional  vectors  (2..,  }  which  make  up 
M  '  J  k 

the  first  block  row  of  L. 
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Step  5.   Add  new  data  to  the  truncated  Hankel  array  K,>,.  until  the  rank 
is  found  to  increase  and  the  realizability  criterion  is  met 
again  for  some  new  integers  N  and  N' ,  and  Nj  =  N  +  N'.   Repeat 
Steps  2-4  to  obtain  a  new  realization  of  degree  No.   And  so  on. 
This  cycle  can  conceivably  continue  infinitely  many  times, 
because  the  given  sequence  is  infinite.   One  method  of  checking 
when  to  stop  is  to  compute  a  realization  of  some  degree,  say 
No,  and  use  (2.32)  to  compare  the  terms  of  the  impulse  response 
sequence  which  are  after  the  No'th  one  with  the  corresponding 
terms  in  the  sequence  being  realized. 
Proof.   Kalman  has  shown  (see  Kalman  et  al. ,  1969)  that  (2.67)  is  satis- 
fied if  and  only  if  there  exists  a  triple  (A,Q,D)    such  that  (2.5a)  is 

Pm 

true.   Thus,  it  suffices  to  show  that  a  realization  constructed  using 

the  algorithm  has  dimension  p   and  satisfies  (2.5a).   This  is  done  by 

showing  that  the  indices  {p.},  the  coefficients  {y.  ,  },  and  the  vectors 

1  'ijk 

{^  ,  }  identified  in  the  algorithm  are  the  invariants  of  the  minimal 

realization  of  the  matrix  sequence  {L  ,L  , ...,L   }. 

12      No 

The  procedure  used  to  select  the  basis  (2.68)  defines  the  integers 

iu.)    uniquely  and  precisely.   The  number  of  vectors  in  (2.68)  is  p  . 

1  M 

Thus,  it  follows  that  p^  =  y,  +  u_  +  . . .  +  y  ;  further,  N'  =  max(p  ). 

n     1     /  r  1 

Also,  in  view  of  (2.4a)  and  the  definition  of  ^  ,  , 


(2.73) 


-jk 


-jk+1 


-jk+N-1 


DA   q. 

da\. 


DA     ^ 


i  =  1  2     r 


k  =  1,2, ... ,u. 


JJ 


and,  correspondingly. 
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(2.74) 


ii.,« 

DA      q. 

y.  +  i 

9 
^iM.+2 

DA           q. 

iM>l 

• 
• 

= 

• 

y.+N-l 

-iy.+N 

DA  \ 

1,2, 


The  above  discussion,  equation  (2.70),  and  Corollary  (2.31)  imply  that 

the  {jJ.}  are  invariants  of  the  minimal  realization  of  {L,  ,L„ , .  .  .  ,L,,  }, 
1  1   2      No 

and  that  N'  is  the  controllability  index  of  the  realization. 

Matrix  L  in  (2.70)  has  full  rank  and  h.       , ,  is  in  its  column  space 

— ly.+i 

(by  construction);  thus,  y_.    as  given  in  (2.72)  is  unique.   It  follows 

from  this  and  Corollary  (2.31)  that  the  vectors  {y . )  are  also  invariants 

—1 

of  the  minimal  realization  of  the  sequence  {L, ,L„ , . . . ,L.,  }. 

12       No 

Finally,  the  vectors  i^.,}   that  comprise  the  first  block  row  of  L 

are  also  invariants  of  the  minimal  realization  of  {L^ ,L„ , . . . ,L^  },  since 

they  are  part  of  the  first  p^,  linearly  independent  columns  of  JC,»,,  ,  ,  . 

M        J  f  NN  +1 

Once  the  realization  invariants  are  known,  the  canonical  form 
(2. 55)- (2. 57)  is  easily  constructed.   That  (2.5a)  is  satisfied  follows 
from  (2.32)  and  Theorem  (2.54).  V 

(2.75)   Remark.   In  the  context  of  the  minimal  realization  problem,  con- 
sider the  case  where  a  minimal  realization  of  degree  No  has  been  ob- 
tained, and  suppose  that  as  more  data  is  added  to  the  Hankel  array,  the 
rank  of  the  array  increases  from  the  value  p  .   Suppose  further  that 
the  realizability  criterion  has  been  met  anew  for  the  data  up  to  the 
Nn' th  element.   The  effect  of  the  No'  -  No  added  data  points  is  to  add  to 
the  basis  (2.68)  some  vectors  which  were  not  included  previously,  and 
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to  add  more  elements  at  the  bottom  of  those  vectors  which  were  already 

in  I  he  h.isis.   As  a  result,  llif  iiiimlier  of  coluimis  in  thr  first  Mdck 

row  of  L  increases.   In  conclusion,  it  is  observed  that  if  the  new  data 

points  cause  the  dimension  of  the  minimal  realization  to  increase,  then 

the  set  of  invariant  vectors  {^.,  )  is  larger,  with  the  further  condi- 

tion  that  the  vectors  which  were  previously  in  the  set  remain  in  the  set. 

If  a  prime(')  denotes  the  invariants  for  the  realization  of  degree  No 

and  the  unprimed  quantities  correspond  to  the  previous  realization  of 

degree  No ,  then  the  above  result  can  be  stated  (using  set  notation)  as 

follows:   {£.,  }  C  {£'  }, 
-jk     -jk 

Unfortunately,  it  is  not  true  that  {y.}  C  {p|}  and  {y.  ,  }  C  (yl  ,  }. 

1      1        ijk      ijk 

It  follows  from  Definition  (2.19)  that  as  p„  increases,  at  least  one 

M 

(possibly  all)  of  the  {y.}  indices  has  to  increase.   By  the  same  token, 
the  size  of  L  increases  and  the  vector  h  ,    in  the  left-hand  side  of 

— LlJ.  +  l 

(2.70)  changes  for  at  least  one  (possibly  all)  value  of  i.   Thus,  at 

every  iteration  (Step  5)  it  may  be  necessary  to  compute  again  one  or 

more  of  the  vectors  {y.}-   However,  it  is  true  that  in  some  cases  sub- 

sets  of  the  sets  {\i .}   and  {y.}  remain  the  same  from  one  iteration  to  the 

1       —1 

next.   For  these  reasons  the  realization  algorithm  proposed  above  can 

be  labeled  as  quasi-recursive.   The  example  given  below  illustrates 

the  application  of  the  algorithm  and  the  quasi-recursive  property.      V 

Bonivento  et  al.  (1973),  Rissanen  (1974),  and  Akaike  (1974)  have 
(independently)  proposed  realization  algorithms  similar  to  the  one  given 
above,  but  they  do  not  discuss  the  quasi-recursive  property  and  some  of 
the  other  significant  points  mentioned  above.   Dickinson  et  al .  (1974a, b) 
discuss  a  related  quasi-recursive  algorithm  from  the  matrix-fraction 
representation  point  of  view.   The  procedure  they  suggest  is  to  modify 
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the  realization  for  every  data  point  that  does  not  "fit"  into  the  cur- 
rent pattern,  rather  than  waiting  to  have  enough  data  points  so  that 
the  realizabiltty  criterion  is  met  anew,  which  is  the  procedure  sug- 
gested in  Algorithm  (2.66).   Their  approach  seems  to  be  more  desirable 
if  the  data  is  available  sequentially,  while  the  one  given  here  seems 
to  be  more  convenient  if  the  complete  sequence  is  available  at  a  time. 
The  algorithm  presented  above  (as  well  as  most  of  the  results  which 
preceded  it  and  follow  next)  was  derived  independently  of  the  results 
in  the  above-mentioned  references. 

(2.76)   Example.   It  is  desired  to  obtain  the  minimal  realization  of 
an  infinite  sequence  which  begins  with  the  following  elements: 


1 


h   = 


h- 


1  0 

0  1 

'-2     r 

0  -2 


0    1 
-1    1 


2 
0 


s- 


h  = 


'10 


13 


-2  -80 

0  -50 

2  879" 

0  580 


11 


14 


0 

1 

T 

1 

-1 

I 

0 

-14 

T 

1 

-5 

1 

0 

157  ~ 

1 

110 

~0 

-1928 

-1 

-i: 

J97 

\  = 


s  = 


-1 

2 

-1 

0 

"l 

-3  ~ 

1 

-2 

-1 

29 

-1 

27 

1          -381 

n      ~ 

I 

1 

-281 

The  partial  Hankel  array  5f   for  the  above  sequence  i 
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3{' 


55 


1 

0 

0 

1     1 

-1 

2 

-2 

1 

0 

1 

0 

1 

-1 

1     1 

1 

-1 

0 

0 

-2 

1 

-1 

0 

1 

-1 

1 

-2 

1 

0 

1 

1 

-3 

-1 

1 

-1 

0 

0 

-2 

1 

-1 

1 

-2 

-1 

2 

-2 

1 

1 

1 

1 

1 

-3 

2 

6 

-1 

0 

0 

._:.__.  ' 

-1 

1 

-2 

0 

7 

-2 

1 

0 

1 

1 

-3 

2 

6 

0 

-14 

0 

-2 

1 

-1 

1 

-2 

0 

7 

-1 

-5 

0 

1 

1 

-3 

2 

6 

0 

-14 

-1 

29 

_^ 

-1 

1 

-2 

0 

7 

-1 

-5 

-1 

27 

It  is  found  that  the  realizability  criterion  is  met  first  with  N 
and  Pj^  =  2.   Inspection  of  Jf^^  gives  1^1=^2"-^  ^^^ 

1     0' 
_0     1 
The  coefficient  invariants  are  obtained  next  as 


=  N'  =  1, 


L   =    [h 


11 


^21'  = 


=  '^11     A21I 


^1  = 

■^111 
__^121_ 

=  -  ^'%2  - 

0 

1 

—          — 

- 

^2   = 

^211 

_^221 

'  -  ■-"'*22  ■ 

-1 
-1 

The  state-space  canonical  representation  of  the  minimal  realization  of 
degree  No  =  N  +  N'  =  2  is  now  easily  obtained  as 


0     1 

-1     1 


Q  = 


1     0 
0    1 


D  = 


1     0 

0    1 


and  the  matrix-fraction  representation  obtained  using  (2 . 61)-(2 . 64)  is 


given  by 


<I>(s)  =  >i'(s)r  \s)    = 


1    0 


0  1 

The   poles   of   the   realization   are   at   0.5   ±   jO.866 


s  -1 

1        s-1 


-1 
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The  reallzability  criterion  is  met  next  for  N  =  N'  =2,  and  p   =  3. 

M 


Thr 


liiu'.irly    indi-pt'iident    columns    of   -"^        are   ^,  ,  ,     '.,,,     i"*!      •>■>• 


so    1 1 


M2   =   2,    and 


L  =    lAu       ZI21       ^22^    = 


1  0  1 

0  1  1 

0  1  2 

-1  1  0 


-11 


-12 


-21 


-22 


-22 


-23 


Column   h   ^   can   depend   only  on  ?2        and  ^      ,    so 


Yi   =  -  L  ii^2 


111 


Y 


121 


Column  h        can  depend  on  all  three  vectors  in  L,  so 


lo  =  -L  /l. 


23 


-1 

1 

-1 


211 


'221 


Y 


222 


Then  the  state-space  and  matrix-fraction  representations  of  the  mini- 
mal realization  of  degree  No  =  N  +  N'  =4  are  obtained  as 


A  = 


0          0             1 

1 

0 

p- 

1 

0 

1 

-1          0          -1 

Q  = 

0 

1 

D  = 

0 

1 

1 

0          1             1 

0 

0 

H'(s)r"^(s)  = 

"1    r 

0          s 

s 

1 

-1 

s^-s-t-1 

-1 

and  the  poles  of  the  realization  are  (approximately)  at:  0.772  +  jl.l2, 
-0.544. 
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It  is  important  to  observe  that  several  realization  invar i. nils 
ri'iiuiin  the  same  in  value  in  passing  from  the  realization  of  deKroo  2 
to  that  of  degree  4.   These  are:  y,,  Y,,,,  Y,2i'  Ai i >  ^nd  I      .      Since 
\i      and  Y]  do  not  change,  the  calculations  to  obtain  ]Y^  are  unnecessary. 

Examining  the  columns  of  3^"- c »  '^a^    ^^^^  Ji'^    for  linear  dependency, 

JD  JO  03 

it  is  found  that  the  realizability  criterion  is  satisfied  next  for  N  = 
N'  =5,  and  p^,  =  7.   The  linearly  independent  columns  of  M^  ,  are  found 
to  be  h      ,    h    .,    h      ,    h^,    h,     ,    h      ,    and  h      .      Therefore,  \i^   =  4,  p^  "  3, 
and 

L  =  [^11   ^12   ^13   ^14  hi      hi      h-i^ 


hi 

^12 

h3 

hi 

hi 

hi 

hi 

^U 

h-. 

h5 

hi 

h3 

h. 

^U 

hi 

he 

h. 

hu 

hi 

^15 

he 

hi 

ho 

hs 

^15 

he 

hi 

hi 

125 

he 

-23 


-24 


-25 

he 


-27 


L  = 


1 

0 

-1 

-2 

0 

1 

2 

0 

-1 

-1 

0 

1 

1 

0 

0 

-1 

-2 

0 

1 

2 

1 

1 

-1 

0 

1 

1 

0 

-2 

1 

-2 

0 

1 

2 

1 

1 

1 

0 

1 

1 

0 

-2 

-1 

2 

0 

1 

2 

1 

1 

-3 

0 

1 

1 

0 

-2 

-1 

-2 

0 

1 

2 

0 

1 

-3 

6 

1 

1 

0 

-I 

-1 

-2 

7_ 

55 


Ko 


Lli    //         iind   h_        can    depend    on    all    the    vectors    in    I,,    so    y      "=    ~    !■   ^',r 


and    Yo    =   ~^-  ilo/  •    The   values   of  y_     and  y_     are    found    to   be 
T 


Y 


^^111        ^112        "^113        ^114 


^121        ^122        ^123^ 


=    [0 


1 


0  0  0  0 


0] 


T       ^         r 

I2         IY211        Y212        ^213        ^214        ^221        ^222 


Y 


223' 


=    [60025-30] 
Now   the    canonical   state-space   and  matrix-fraction   representations   of 
the   minimal   realization   of   degree   No    =   N  +  N'    =    10  are   easily   construc- 
ted.     They  are   given  by 


A  =    ti2       ^3       h       -^l       h       iy        -^2^ 


B  =  [Ah   A12   il3   ^14   ^21   ^22   A23I 


Q  =  til     15] 


>(s)  =  H'(s)r  ^s)  = 


s^-s-l    2s^+s 


-s^-s 


1*  . 
s  +s 


2s '+6 


0    s^-3s+5 


s  -s-5 

The  poles  of  the  realization  are  (approximately) at :  0.0,  -1.0,  -2.28, 
0.5  ±  jO.866,  1.14  ±  jO.946. 

As  expected,  the  only  invariants  that  do  not  change  in  value  in 
passing  from  the  preceding  realization  are:  ^,  ,  ,   A9  1  >  ^"'^  Aoo* 

Using  (2.32)  it  is  found  that  the  elements  L, , ,  L   ,  L,^,  and 
L   of  the  impulse  response  sequence  of  the  above  realization  agree 
with  the  corresponding  elements  of  the  given  matrix  sequence.   Thus, 
the  above  realization  is  the  minimal  realization  (of  degree  14)  of  the 
given  sequence.  V 

(2.77)   Remark.   In  the  process  of  executing  Steps  1  and  5  in  Algorithm 
(2.66),  if  an  appropriate  numerical  procedure  is  used,  it  is  possible  to 
obtain  the  invariants  {y.-i^}  concurrently  with  the  invariants  {y.}  and 
{X-j.}  when  checking  the  columns  of  the  truncated  Hankel  array  for 
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liiuMr  dei)endencies.   This  problem  is  ciirrtTUly  In-iiij.,  i  nvcst  i  j'.il  c.l  l.y 
Cindy  (1975),  and  preliminary  results  show  an  interesting  rel  at  ii.nsli  i  p 
with  tlu'  previous  work  of  Rissancn  (1971).  y 

An  algorithm  to  solve  the  minimal  partial  realization  problem  is 
presented  next.   The  algorithm  has  the  same  convenient  features  of  Algo- 
rithm (2.66);  that  is,  the  realization  invariants  are  identified  and 
the  realization  is  obtained  in  canonical  form.   Further,  this  algorithm 
can  be  used  as  an  alternate  constructive  proof  for  Theorem  (2.16),  which 
has  some  advantages  over  the  proof  given  by  Kalman  (1971b)  and  Tether 
(1970).   This  algorithm  is  also  the  subject  of  a  forthcoming  paper  by 
Roman  and  Bullock  (1975). 
(2.78)   Minimal  Partial  Realization  Algorithm. 

^"^^P  ^-   f"o™  the  truncated  generalized  Hankel  matrix  -Tf,  ^,   (the  mNo  xrNo 

No  No 

upper  left-hand  block  of  3f  in  (2.11)).   As  before,  let  h        be 
the  (r(k-l)+j)th  column  of  \^^^  ,    and  suppose  that  h        is  not 
a  null  vector  (for  notational  simplicity).   Starting  with  h 
examine  (in  order)  the  fixed  portion  (specified  elements)  of 
the  columns  of  7f^^^^  for  linear  dependence  upon  the  correspond- 
ing portion  of  the  preceding  columns,  and  keep  the  linearly 
independent  columns  (including  /^^  ^  .   That  is,  if  the  fixed 
portion  of  K^    (which  is  denoted  as  h.^)    is  linearly  indepen- 
dent of  the  corresponding  portion  of  the  same  length  of  its 
preceding  columns,  then  K^   is  kept;  otherwise,  it  is  rejected. 
Take  the  selected  columns  and  rearrange  their  order  so  that 
the  second  subscript  varies  the  fastest.   This  results  in  the 
ordering  (2.68).   The  integers  {p.}  which  are  implicitly  de- 
fined in  (2.68)  are  the  controllability  indices  of  the  minimal 
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realization  of  the  given  partial  sequence,  and  the  dimension 

of  the  realization  is  n„  =  )i,  +  u„  +  ii  . 

M  ]  Z  r 

Sli'P    2.       The    lixc'd    norLii)n    ol"    Llie    vectors    /; ,       ,,,    //,,       .,,     ...,// 

are  of  length  mCNo-y.)  for  i  =  1,2,. ..,r,  and  are  linearly 
dependent  on  the  corresponding  portions  of  the  same  length  of 
the  vectors  in  (2.68).   More  precisely,  due  to  the  selection 
procedure,  used,  h.       ,,  for  i  =  l,2,...,r,  is  linearly  depen- 

— lU.  +  l 

1 
dent  on  the  corresponding  portions  of  the  same  length  of  the 

vectors  in  (2.69).   As  before,  the  length  of  the  "chains"  in 

(2.69)  is  equal  to  O..  calculated  according  to  (2.23).   Also, 

O.    <  Pw  (with  o_    defined  as  in  (2.51)).   If  L  is  the  mNo  xp,, 

1  =  M        1  M 

matrix  whose  columns  are  the  vectors  in  (2.68)  in  that  order, 
and  M.  is  the  m(No-)J.)xp   top  portion  of  L,  then  the  dependency 
of   h.       ,,  for  i  =  l,2,...,r,  on  the  corresponding  portions  of 

— lU.+l 

1 
the  same  length  of  the  vectors  in  (2.69)  can  be  written  as 

(2.79)  ^+i  =  A^i  i=l,2,...,r 
where  the  hat  (^)  over  matrix  M.  denotes  that  some  columns  of 

M.  are  not  (generally)  included,  and  y.    is  as  defined  in  (2.71). 
M.  is  an  m(No-y.)xO.  matrix  and,  depending  on  the  actual  values 
of  the  given  sequence,  the  value  of  m(No-y.)  may  be  less  than, 
equal  to,  or  greater  than  the  value  of  O..      By  construction,  a 
solution  vector  y_.    for  (2.79)  exists,  but  it  is  possible  that 
it  may  not  be  unique.    Nonuniqueness  results  whenever  p(M.)  <a. 
(more  unknowns  than  linearly  independent  equations),  and  the 
number  of  degrees  of  freedom  available  is  given  by 

r  r   ^ 

(2.80)  I   (a.   -   p(M.))  =  a  -  I   p(M.) 
1=1   ^      "■         i=l    ^ 
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Step  3.   The  minimal  partial  realization  of  the  given  sequence  has  di- 

1111  MIS  ion     p     ,     .mil     (he      1  l   i  p  I  <•       (A  ,(),  I))  i  :;    <  (  m; ;  I   i  nr  I  i 'il      In     I  he 

M  I'm 

form  (2.  _S5)-(2 .  57)  using  the  Indices  {p.  I  idcntifieii  in  Step  I, 
the  coefficients  (y..,  }  identified  in  Step  3  (some  of  v-7hich 
may  be  arbitrary),  and  the  p   m-dimensional  vectors  {_^.,.}  which 
make  up  the  first  block  row  of  L. 
Proof.   The  proof  is  based  on  the  discussion  which  follows  equation 
(2.11)  and  on  the  proof  of  Algorithm  (2.66). 

Notice  that  the  procedure  used  to  select  the  linearly  independent 
vectors  h.,     in  Step  1  is  equivalent  to  the  procedure  used  to  compute  p 
according  to  (2.13).   Consequently,  the  set  of  integers  (y.)  obtained 
in  Step  1  is  the  set  of  controllability  indices  of  any  minimal  realiza- 
tion oi  the  given  sequence.   It  follows  that  p..  =  u,  +  U^  +  • . •  +  y  . 

M     12  r 

Notice  also  that  y  =  max(y.)  £  No. 

The  fixed  portion  of  the  vectors  h.       ,,  for  i  =  l,2,...,r,  is 

— ly.+l 
1 

linearly  dependent  on  the  corresponding  portions  of  the  same  length 

of  the  vectors  in  (2.69);  thus,  in  view  of  the  definition  of  M. ,  (2.79) 

has  at  least  one  solution  vector  j_.  ,      The  solution  is  unique  if  and  only 

if  p(M.)  =0.,  and  nonunique  if  and  only  if  p(M.)  <  O   (where  o.  is  as 
11  11         1 

defined  in  (2.51),  and  the  integers  {o..}  are  defined  by  (2.33)  in  terms 
of  the  (y.}  invariants).   Only  those  scalars  Y...  which  are  uniquely 

1 J  K 

specified  are  invariants  of  the  minimal  partial  realization;  those 

which  are  arbitrary  cannot  be  called  invariants.   M.  is  dimensioned 

ni(N„-y .  )xo_  ,   It  follows  that  M.  is  not  defined  for  y.  =  No  .   This  cor- 
11  1  1 

responds  to  the  case  where  the  left-hand  side  of  (2.79)  is  unspecified, 
and  therefore,  p(M.)  =  0  must  be  used  in  (2.80). 
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Notice  also  that  the  vectors  i^.,   1  which  comprise  t  lie  first  lilork 
row  of  1^  are  also  invariants  of  the  minimal  partial  realization. 

Suppose  now  that  either  the  solution  to  (2.79)  is  unique  for  all 

values  of  i,  or  that,  if  nonunique  for  some  values  of  i,  the  arbitrary 

Y...  have  been  designated  a  value  according  to  some  criterion.   Either 
ijk 

way,  equation  (2.32)  is  satisfied  for  values  of  T  in  the  range 

0  <  T  £  No-y..   Now  substitute  the  parameters  (p.),  {y..,},    and  the 
-~   —     1  1     ijk 

available  vectors  {2_.,  }  in  (2.32)  for  T  >  No  -  V .  ,  i  =  l,2,...,r,  to 
construct  the  elements  of  an  extension  sequence.   It  follows  that  such 
an  extension  satisfies  (2.11)  for  all  values  of  i  and  j,  and  is,  there- 
fore, a  minimal  extension  sequence. 

Finally,  the  canonical  form  (2. 55)-(2. 57)  is  easily  constructed 
with  the  identified  invariants.  V 

It  should  be  emphasized  that  (in  both  Algorithms  (2.66)  and  (2.78)) 
it  is  not  mandatory  to  construct  the  minimal  realization  in  the  canoni- 
cal form  of  Theorem  (2. 54).   Any  matrix  triple  which  satisfies  (2.32) 
with  DA   ^   in  place  of  _£    is  equally  acceptable  as  a  minimal  realiza- 

K  JK 

tion.   Form  (2. 55)- (2. 57)  is  adopted  here  for  convenience  and  simplicity. 

Another  interesting  point  is  that  Algorithm  (2.66)  can  be  viewed 
as  a  successive  application  of  Algorithm  (2.78)  in  the  special  case 
where  (2.79)  has  a  unique  solution  for  all  values  of  i.   The  following 
remarks  are  also  noteworthy. 

(2.81)   Remark.   The  construction  of  a  minimal  extension  sequence  out- 
lined in  the  proof  of  Algorithm  (2.78)  serves  as  a  proof  for  Theorem 
(2.13)  (due  to  Kalman,  1971b,  and  Tether,  1970).   Besides  being  simple 
to  apply.  Algorithm  (2.78)  displays  the  structure  and  invariants  which 
are  common  to  all  minimal  realizations  of  the  given  partial  sequence, 
and  lumps  all  the  available  degrees  of  freedom  in  matrix  A.   These 
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piopcTt  ios  allow  the  possibility  of  constructing  the  minimal  rea  1  Lz.iL  i  on 
which  Ills  I  lu'  most  convcn  U'nt  set  of  poles  or  the  most  ili'sirahle  si  i  ii.  - 
tuie  (even  both  in  some  cases)  among  all  the  possible  minimal  realiza- 
tions, in  a  manner  much  simpler  than  with  the  constructions  used  by 
Kalman  (1971b)  and  Tether  (1970).  V 

(2.82)   Remark.   As  previously  mentioned,  the  state-space  canonical 
form  of  Theorem  (2.54)  is  not  the  only  canonical  form  that  can  be  de- 
fined for  S(p)  under  the  action  of  GL(p).   Other  complete  systems  of 
invariants  can  be  obtained  by  examining  the  columns  (rows)  of  ^   for 
linear  dependencies  according  to  a  rule  different  from  the  one  discussed 
here  (see,  for  example,  Denham,  1974).   However,  it  is  well  known 
(Kalman,  1971a;  Rosenbrock,  1970)  that  the  {y. }  invariants  identified 
here  are  the  unique  set  of  integers  which  determines  the  size  of  the 
smallest  possible  cyclic  subsystems  into  which  the  system  can  be  divided 
using  state  feedback,  put  a  lower  bound  on  the  degrees  of  the  invariant 
factor  polynomials  that  can  be  attained  using  state  feedback,  and  de- 
fine the  size  of  the  smallest  controllability  subspaces  that  can  be 
attained  for  a  system  with  state  feedback  (for  the  definition  and  an 
extensive  discussion  of  controllability  subspaces  see,  for  example, 
Warren  and  Eckberg,  1974,  or  the  references  therein).   For  these  and 
other  related  reasons,  the  controllability  indices  seem  to  be  the  set 
of  integers  which  best  define  the  basic  structure  of  a  system.   Analog- 
ously, the  associated  parameters  (y..,  }  and  vectors  {&,,  }  contribute  to 
-^ '  "^  ijk  — jk 

completely  define  a  system  in  its  most  basic  structure. 

The  canonical  form  (2. 55)- (2. 57)  constructed  with  these  invariants 
has  o  +  pm  f  p(r  +  m)  non-trivial  elements  (different  from  O's  and  I's). 
This  is  the  smallest  number  of  non-trivial  elements  needed  to  represent 


61 


the  basic  structure  of  a  system.   From  Theorem  (2.49)  and  Remark  (2.58) 
il  follnws  that  it  is  not  possible  to  represent  a  system  with  a  smaller 
number  of  non-trivial  elements  by  using  other  state-space  canonical 
forms.   Also,  the  structure  obtained  with  another  canonical  form  can  be 
quite  different  from  the  actual  basic  structure  of  the  system.   Some 
of  the  other  canonical  forms  often  lead  to  non-general  and  even  mislead- 
ing results  when  used  in  the  minimal  partial  realization  problem  context. 
This  topic  is  discussed  further  next.  V 

(2.83)  Remark.   Ackermann  (1972)  has  proposed  an  algorithm  to  solve 

the  minimal  partial  realization  problem  using  a  procedure  different 

from  the  one  discussed  here.   His  procedure  consists  of  examining  the 

columns  of  7C,  ^,   (actually,  he  examines  the  rows  of  3^.,  .,  ,  but  the  dual 
No  No  No  No 

of  his  method  is  considered  here  for  notational  convenience  and  for  com- 
parison purposes)  for  linear  dependency  in  the  following  order 

(2. 84)  h^^,    ?z^2'  •••'  ^iNo  '  -21'  -22'  *•''  -2No  '  •*•' 

-rl'  -r2'  •••'  -rNo 
and  retaining  the  columns  found  to  be  linearly  independent  of  their 

preceding  columns.   Then,  following  the  same  lines  as  in  this  disser- 
tation, his  procedure  leads  to  a  canonical  form  of  the  type  (2.55)- 
(2.57),  but  which  differs  in  that  the  size  of  the  subsystems  is  gen- 
erally larger,  and  the  subsystems  are  coupled  only  in  the  backward  di- 
rection (that  is,  A. .  =  0  for  i  >  j). 

Recently,  Ledwich  and  Fortmann  (1974)  have  shown  by  examples  that 
the  partial  realization  algorithm  of  Ackermann  (1972)  often  gives  non- 
minimal  and/or  misleading  results.   These  cases  can  occur  only  if  the 
given  partial  sequence  does  not  satisfy  the  realizability  criterion. 
because,  otherwise,  the  minimal  partial  realization  is  unique.   The 
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Ihcc.ry  (liscussi'd  in  this  work  .in.l  Al^;(iriLhm  (2.7H)  provide  .1  liui.l 
explanation  for  the  Ideas  that  Ledwlch  and  Fortmann  (1974)  attempted 
to  convey  via  examples. 

The  partial  realization  algorithm  of  Ackermann  (1972)  is  based  on 
the  minimal  complete  realization  algorithm  of  Ackermann  and  Bucy  (1971). 
More  recently,  Mayne  (1972)  and  Mital  and  Chen  (1973)  have  also  addressed 
(independently)  the  minimal  realization  problem  via  the  same  approach. 
It  should  be  mentioned  that  in  the  minimal  complete  realization  problem 
context,  the  algorithms  lead  (in  all  cases)  to  realizations  which  are 
truly  minimal.   This  is  due  to  the  fact  that  if  the  given  sequence  ad- 
mits a  finite-dimensional  realization,  then  the  realizability  criterion 
is  met  and  the  minimal  realization  (of  dimension  equal  to  the  rank  of 
the  Hankel  matrix)  is  unique.  '^ 

The  following   example  (due  to  Ledwich  and  Fortmann,  1974)  illus- 
trates the  application  of  Algorithm  (2.78)  and  several  of  the  ideas  dis- 
cussed above. 

(2.85)   Example.   It  is  desired  to  obtain  a  minimal  realization  for  the 
following  partial  sequence 


h  = 


0  0 

1  i_ 

The  partial  Hankel  array  'H'  „  is 


1 

1 

3 

2 

3 

3 

s  = 

0 

K 


33 


0 

0 

1 

1 

3 

3 

1 

1 

3 

3 

0 

1 

1 

1 

3 

3 

* 

* 

3 

3 

0 

1 

* 

* 

3 

3 

* 

* 

* 

* 

0 

1 

* 

* 

* 

* 
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The  minimum  number  of  linearly  independent  columns  that  '>C        can  have 
(ignoring  the  positions  occupied  by  asterisks)  is  found  to  be  4.  Thus, 


=  4.   The  linearly  independent  columns  are  h-.,,   ^o]'  —12''  "^"'^  - 


22' 


Th 


is  implies  y,  =  y„  =  2 ,  and 


L  =  [h^^ 


hi     hi 


-22 


From  (2.23),  O ^^   =  a ^^   =   O^^   =   O^^   =  2;  so,  o^   =   O^   =   ^,    a  =   8,    and 


M  =  M  = 
1     2 


0 
1 


The  equations  to  solve  for  the  coefficients  {y. .,  }  are 


K 

13   '' 

=   -M^y 

■1 

"3' 

'0 

1 

0 

1 

0 

1 

3 

1 

3 

111 


112 


Y 


121 


122 


h 

23 

=   -M2I2 

3 

"0 

1 

0 

1 

_1_ 

_1 

3 

1 

3 

211 


'212 


'221 


Y 


222 


Since  p(M,)  =  p(M  )  =  2,  there  are  4  degrees  of  freedom  in  the  choice 

of  the  eight  parameters  {y..j^}.   Let  y^^^,    Y^^2'  ^221'  ^"'^  "^222  ^^  ^^^^ 
arbitrary  variables.   Then  the  remaining  ones  are  specified  as 


^121    ^    ^111 


Y 


122 


-  3  -  Y 


112 


^211   ^   ^221 


'212 


-  3  -  Y 


222 
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Define  the  characteristic  polynomial  of  A  as  follows 

|si  -  a|  =  s"*  +  3^3^  +  B^s^  +  B^s  +   6j 

Now  substitute  the  (y.^^)  parameters  in  A  according  to  (2.55),  and 
evaluate  its  characteristic  polynomial  in  terms  of  these  parameters. 
Replace  Y^21'  ^122'  ^211'  ^^^   ^212  ^^  their  equivalent  in  terms  of  y 
^112'  '''221'  ^"'^  ^222'  ^^^^   results  in  a  fourth-order  polynomial  involv- 
ing these  last  four  variables  only.   Equating  the  coefficients  with 
those  in  the  above  definition  of  | si  -  a|  gives  the  following  matrix 
equation 

'""''"  8     0     9     0" 

-3     8-3     9 

1-3     1-3 

0     10     1 

It   is  observed   that   since   the   parameters  Y,,,,    Y~       ""y  '~and~Y  arP 

'ill'  '112'  '221'      '222 

arbitrary  and  the  matrix  in  the  above  equation  is  nonsingular,  then  the 

coefficients  of  the  characteristic  polynomial  of  A  are  arbitrary.  Equi- 

valently,  there  exists  a  unique  set  of  parameters  (y  ,  }  that  gives  any 

ijk       *       ^ 

four  specified  poles  (subject  to  complex  poles  occuring  in  conjugate 
pairs)  for  a  fourth-order  minimal  realization  of  the  given  sequence. 

In  terms  of  the  coefficients  of  the  characteristic  polynomial  of 
A,  the  parameters  Y^^^,  y^^^,    y^^^,    and  y^^^   are  specified  as 


^r 

^2 

^3 

^ 

pill' 

-72 

^112 

+ 

51 

^221 

-9 

^222 

0 

1 —  _ 

^           _ 

111 


112 


'221 


U222_ 


L° 


0  9  27 

-1  -3  0 

0  -8  -24 

1  3  1 


h 

9 

h 

24 

h 

+ 

0 

J^. 

-24 

For  the  choice  6^  =  4.  6^  =  10.  63  =  10,  and  6^  =  5.  the  minimal  partial 
realization  is 
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— 

"~ 

■^ 

0 

-230 

0 

-204 

1 

(3 

1 

16 

0 

24 

() 

0 

0 

0 

2  2  1 

0 

!")() 

0 

1 

0 

-13 

1 

-21_ 

_o 

0 

D   = 


0  10  1 

13  13 

and    its  matrix-fraction   description    is    given   by 


tCs)  = 


1    1 


■1 


s^-16s+230      -24S+204 
13S-221    s^+21s-196 
The  poles  of  this  realization  are  at  -1.0,  -2.0,  -1.0  ±  jl.O  (as 
desi  red) . 

The  following  observations  can  be  made.   Notice  that  the  only 
(minimal  partial)  realization  invariants  in  this  example  are  the  con- 
trollability indices  iu,,    IJo)  and  the  vectors  {_^,  ,  »Ai  o  '  loi 'Aoo^  •   None 

(jf  the  iy..,  }  parameters  is  an  invariant  in  this  problem.   Notice  also 
ijk 

that  the:  available  degrees  of  freedom  allow  arbitrary  poles  for  the 
iiiiiiimal  realization.   In  several  applications  (see  Chapter  4),  such  .. 
situation  is  desirable.   The  occurrence  of  this  phenomenon  is  investi- 
gated in  the  following  chapter.   Finally,  consider  the  following  com- 
parison with  results  obtained  using  the  partial  realization  procedure 
ot  Ackermann  (1972)  to  solve  this  problem. 

In  a  recent  technical  note,  Ledwich  and  Fortmann  (1974)  solved 
tills  example  using  the  partial  realization  algorithm  propcised  by 
Ackermann  (1972),  and  discussed  some  of  the  deficiencies  of  the  algorithm. 
Their  results  show  Ackermann's  realization  has  dimension  equal  to  5 
(nt)t  minimal)  and  four  arbitrary  poles,  and  with  a  reordering  of  the 
output  terminals,  the  realization  has  dimension  equal  to  4  and  three 
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arbitrary  poles.   If  the  dual  of  Ackermann's  algorithm  (as  outlined  in 
KcMiiark  (2.83))  is  used,  the  realization  has  dimension  ec|iial  Lo  Idiir 
aml  two  arbitrary  poles  for  both  possible  orderin^s  of  tlie  input  Li-r- 
minals. 

Ledwich  and  Fortmann  (1974)  also  point  out  that  the  choice  of  the 
arbitrary  parameters  and  the  ordering  of  the  input  (output)  terminals 
in  Ackermann's  algorithm  can  increase  the  dimension  of  the  realiza- 
tion.  These  deficiencies  are  a  consequence  of  the  procedure  used  to 

obtain  the  linearly  independent  columns  of  JK",  .,  ,  because  the  procedure 

No  No  ^ 

does  not  account  for  the  possibility  that  /?.,  may  not  belong  to  the 

-jk    -^ 

basis  if  it  is  compared  with  the  portions  of  the  same  length  of   h      .    for 

— ik 

i  =  l,2,.,.,r  and  k'  <^  k,  rather  than  just  for  i  i^  j  and  k"  £  k.   This 

search  procedure  (generally)  leads  to  the  identification  of  less  than 

o  +  pm  realization  parameters,  but  it  is  clear  by  now  that  a  considerable 

loss  in  generality  (and  possibly  even  in  minimality)  is  also  expected 

to  result.  y 

In  closing  this  chapter,  it  remains  to  state  that  the  information 
about  the  number  and  character  of  the  available  degrees  of  freedom  and 
about  the  structure  of  the  minimal  realization  which  is  obtained  using 
Algorithm  (2.78),  can  also  be  obtained  (at  least  conceptually)  via  other 
realization  algorithms  (for  example.  Ho  and  Kalman,  1966;  Tether,  1970; 
Kalman,  1971b;  Rissanen,  1971;  Silverman,  1971),  but  the  amount  of 
effort  (and  bookkeeping)  involved  is  discouraging. 


CHAPTER  3 
NEW  PROBLEMS  IN  PARTIAL 
REALIZATION  THEORY 

Often  it  is  desirable  (possibly  necessary)  that  the  partial  reali- 
zation obtained  for  a  specified  finite  sequence  be  stable  besides  having 
dimension  as  small  as  possible.   The  situation  also  occurs  where  the 
realization  is  required  to  have  arbitrary  poles  in  addition  to  having 
dimension  as  small  as  possible.   These  problems  arise  in  network  theory, 
where  a  linear,  time-invariant,  stable  network  must  often  be  synthesized 
to  exhibit  a  (partially)  prescribed  impulse  response.   They  also  arise 
in  control  theory  in  the  design  of  minimal  order  observers,  where  they 
arc  problems  of  significant  importance.   Besides  having  these  relevant 
applications,  these  two  problems  are  of  interest  in  their  own  right. 

The  purpose  of  this  chapter  is  to  formulate  the  minimal  partial 
stable  realization  problem  and  the  minimal  partial  arbitrary  realiza- 
tion problem,  and  to  present  a  solution  in  the  form  of  realization  al- 
gorithms.  In  other  words,  the  construction  of  extension  sequences  that 
are  not  necessarily  minimal  but  have  other  properties  (namely,  stable 
or  arbitrary  poles)  is  considered  here.   It  is  interesting  to  note  that 
these  problems  have  not  been  discussed  elsewhere. 

Problem  Statement 

The  minimal  partial  stable  and  the  minimal  partial  arbitrary  rea- 
lization problems  are  defined  next. 

(3.1)   Definition.   Given  a  finite  sequence  {L, ,L„, . . . ,L.,  }  of  mxr  ma- 

1   z       No 

trices  which  define  the  first  No  terms  in  the  im- 
pulse response  of  a  (possibly  infinite-dimensional) 
67 
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system,  find  a  triple  (A,Q,D)   such  that 

P 

a)   L.  =  Da'-'^Q  i  =  1,2 r^, 

li )   |i  i  :■    .1:;  .Mil.!  I  I  ,is  |i().';:;  j  li  I  c  ,  .mil 

c)   A  has  all  its  eigenvalues  with  negative 

real  parts. 

The  triple  (A,Q,D)   is  then  said  to  be  a  minimal 

P 

partial  stable  realization  of  {L,  ,L„ , .  .  ,  ,L.,  }. 

(3.2)  Definition.   Given  a  finite  sequence  {l,,L^,...,L   }  of  mxr  ma- 

12      No 

trices  which  define  the  first  No  terms  in  the  im- 
pulse response  of  a  (possibly  infinite-dimensional) 

system,  find  a  triple  (A,Q,D)   such  that 

P 

a)  L.  =  da"-"  Q  i  =  1,2,...,No 

b)  p  is  as  small  as  possible,  and 

c)  A  has  arbitrary  eigenvalues. 

The  triple  (A,Q,D)   is  then  said  to  be  a  minimal 

partial  arbitrary  realization  of  {L  ,L„,...,L   }. 

12      No 

(3.3)  Definition.   The  value  of  p  which  satisfies  Definition  (3.1)  is 

denoted  as  p  ,  and  p   denotes  the  value  of  p  which 

satisfies  Definition  (3.2). 
The  solution  to  the  above-defined  problems  requires  the  construc- 
tion of  extension  sequences  which  may  not  be  minimal  but  possess  other 
properties;  namely,  stable  or  arbitrary  poles.   These  extension  sequen- 
ces are  referred  to  as  minimal  stable  and  minimal  arbitrary  extension 
sequences,  respectively. 

In  the  preceding  chapter,  a  procedure  due  to  Kalman  (1971b)  and 
Tether  (1970)  to  construct  a  minimal  extension  sequence  is  briefly 
discussed.   With  a  slight  modification,  the  same  approach  can  also  be 
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used  to  construct  an  extension  sequence  which  is  not  minimal.   Namely, 
the  elements  of  the  extension  sequence  are  now  chosen  to  disrupt  (as 
opposfd  to  prosLTvo)  existing  linear  dependencies  amonj;  Lhc  coliiimis  ol 
K     in  (2.11).   For  a  given  partial  sequence,  there  exist  infinitely 
many  ways  of  doing  so.   But  one  must  again  be  extremely  careful,  be- 
cause a  poorly  chosen  extension  sequence  can  force  the  minimal  realiza- 
tion of  the  complete  (partial  plus  extension)  sequence  to  have  an  un- 
desirably large  dimension  (possibly  infinite). 

The  problem  of  constructing  an  extension  sequence  becomes  much  more 
complicated  if  the  extension  sequence  is  to  be  such  that  the  minimal 
realization  of  the  complete  (partial  plus  extension)  sequence  must  have 
a  prescribed  dimension  and/or  other  properties,  as  in  the  problems  of 
Definitions  (3.1)  and  (3.2).   An  attractive  and  reasonable  way  to  attack 
these  problems  is  to  investigate  the  basic  structure  and  parameters 
common  to  all  partial  realizations  having  the  desired  properties,  as 
done  in  Chapter  2  for  minimal  partial  realizations.   Such  a  solution  is 
presented  in  this  chapter  for  the  minimal  partial  stable  and  the  minimal 
partial  arbitrary  realization  problems. 

The  approach  taken  is  to  first  show  the  existence  of  arbitrary 
extension  sequences  for  a  partial  sequence.   It  follows  that  there  is 
a  minimal  one  among  all  the  arbitrary  extension  sequences.   The  exis- 
tence of  stable  extension  sequences  (and,  correspondingly,  of  a  minimal 
one)  is  also  implied  (in  view  of  the  direction  of  the  inequalities  in 
(3.4)).   The  proofs  of  these  results  suggest  iterative-type  algorithms 
to  solve  the  corresponding  realization  problems. 
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Existence  of  Stable  and  Arbitrary 
Extension  Sequences 

Tn  view  of  Example  (2.85),  it  is  clear  that  stable  and  arbitrnry 

extension  sequences  do  exist,  at  least  for  some  partial  sequences.  That 

such  extension  sequences  do  indeed  exist  for  all  partial  sequences,  and 

the  relation  of  p^  and  p.  with  p,,  is  shown  in  this  section. 
S       A       M 

Based  on  the  results  of  Chapter  2  it  can  be  stated  that  all  mini- 
mal partial  realizations  of  a  given  finite  sequence  have  the  same  set 
of  controllability  indices,  and  that  a  partial  realization  of  a  given 
finite  sequence  cannot  have  dimension  lower  than  p  .   It  follows  that 

(3.4)  Pa^Ps^Pm 

and  that  the  controllability  indices  of  a  partial  realization  cannot  be 

smaller  than  the  controllability  indices  of  a  minimal  partial  realiza- 
tion (of  the  same  finite  sequence).   This  is  a  very  important  point, 
and  it  should  be  kept  in  mind  throughout  the  remainder  of  this  disser- 
tation.  It  is  made  more  precise  with  the  aid  of  the  following  defini- 
tions. 

(3.5)  Definition.   The  set  of  controllability  indices  of  a  minimal  par- 

tial realization  of  a  finite  matrix  sequence  is 
called  the  set  of  minimal  controllability  indices 

and  it  is  denoted  as  {u.„}. 

iM 

(3.6)  Definition.   A  set  of  indices  {p.}  is  said  to  be  an  admissible 

set  of  controllability  indices  for  a  partial  reali- 
zation of  a  finite  matrix  sequence  if  and  only  if 

(3.7)  u>u  i=12r 

where  (U-w)  Is  the  set  of  minimal  controllability 
indices  of  the  given  partial  sequence. 
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(3.8)  Definition.   The  set  of  all  admissible  sets  of  controllability 

indices  for  a  partial  realization  of  dimension  p  of 

a  given  finite  matrix  sequence  is  denoted  by  M(p). 

That  is, 

M(p)  =  {{y.}  :  {y.}  is  an  admissible  set  of 

controllability  indices  and  y  +  y_  + 

.  .  .  +  y  =  p} 
r 

In  the  light  of  these  definitions,  if  a  finite  matrix  sequence  ad- 
mits a  partial  (non-minimal)  realization  of  dimension  p,  then  the  con- 
trollability indices  of  the  realization  belong  to  M(p).   However,  it  is 
not  necessarily  true  that  the  elements  of  M(p)  for  a  given  finite  matrix 
sequence  and  a  specified  value  for  p  are  the  controllability  indices  of 
a  partial  realization  of  dimension  p  of  the  given  matrix  sequence.   In 
other  words,  it  is  possible  that  a  finite  matrix  sequence  does  not  ad- 
mit any  partial  realization  of  a  given  dimension.   This  is  discussed  in 
more  detail  in  the  sequel  (Remark  (3.35)). 

(3.9)  Notation.   In  the  remainder  of  this  dissertation,  the  character- 
istic polynomial  of  matrix  A  is  denoted  as 

3(s)  =5^+6  sP~^  +  ...  +  6„s  +  6, 
P  2     1 

and  the  set  of  coefficients  (B,  }  defines  the  following  p-dimensional 
vector 

3^  =  [6,   6„   ...  6  ]  V 

-      1     2        p 

The  requirements  that  (A,Q,D)   define  a  stable  system  or  a  system 
with  arbitrary  poles  can  now  be  equivalently  replaced  by  the  require- 
ments that  the  coefficients  {&.}   define  a  stable  polynomial  (that  is, 
a  polynomial  whose  roots  are  all  in  the  left-hand  of  the  s-plane)  or  be 
arbitrary,  respectively. 


72 


The  various  results  that  follow  state  several  necessary  aiul/or 
snllirunl  conditions  for  a  partial  stable  or  arbitrary  rc-a  1  i /.a  I  i  on  lo 
exist,  and  constitute  the  basis  for  the  realization  algorithms  presented 
in  the  next  section. 

(3.10)   Theorem.   A  triple  (A.^.D)^  is  a  partial  arbitrary  realization 
of  a  finite  sequence  i^^A^, .  .  .  ,i^^}    of  m-dimensional 
(column)  vectors  if  and  only  if  p  ^  No . 
Proof.   Sufficiency.   Notice  that  for  r  =  1  there  is  only  one  controlla- 
bility index  and  it  is  equal  to  p.   Also,  as  shown  in  the  proof  of  Al- 
gorithm (2.78),  y  >  No  is  indeed  an  admissible  controllability  index. 

From  the  proof  of  Lemma  (2.21)  it  can  be  concluded  that  the  {y    } 
coefficients  are  equal  to  the  {Q^}    coefficients  in  this  case.   Therefore, 
(2.32)  becomes 
(3.11) 


^+1+T 


T  =  0,1,2,.. 


For  p  >  No  the  left-hand  side  of  (3.11)  is  unspecified.   Thus,  an  exten- 
sion sequence  (1^0+1 '4o+2 ' "  '  "^  ""  ^^  chosen  to  satisfy  (3.11)  for  any 
given  set  of  coefficients  {8^}.   The  triple  iA,^,U)^   can  be  chosen  in 
the  single-input  form  of  (2. 55)-(2 . 57) : 

„T 


(3.12) 


(3. 13) 


A  = 


£  =  A, 


Vi 


I 


p-1 


-S 


(3.14a) 


D  =  [d^ 


(3-l^b)         d.  =    i 

—1  — i 

Necessity.   Let  p  >  No 
can  be  written  as 


d„    ...  d  ] 


-  1.   For  T  =  0,1, 


i  =  1,2,. ..,No 
,No-p-I,  equation  (3.11) 
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(i-r)) 


t 


p+1 


-No 


-p+1 


—No -p    —No -p+ 1 


£, 


No-1 


3 


This  is  a  set  of  m(No-p)  equations  in  p  unknowns.   A  completely  arbitrary 
solution  vector  exists  if  and  only  if  the  nullity  of  the  matrix  in 

(3.15)  is  equal  to  p.   Such  a  condition  is  impossible  unless  the  sequence 
is  a  null  sequence  (that  is,  all  its  elements  are  zero),  and  as  stated 

in  the  discussion  which  follows  Remark  (2.16),  this  trivial  case  is  ex- 
cluded. V 

T 

(3.16)  Notation.   The  symbol  ^.  is  used  in  the  sequel  to  represent  the 

ith  element  of  a  sequence  of  r-dimensional  row  vectors.   This  new  symbol 

T 
is  preferred  over  the  symbol  2^.  to  avoid  confusing  a  row  vector  sequence 

with  the  transpose  of  a  column  vector  sequence.   Likewise,  to  avoid  con- 
fusing the  rows  of  L  with  the  transpose  of  the  columns  of  L  ,  the  sym- 

k  K 

T  T 

bol  r,   ,  ,  rather  than  £.,  ,  is  used  to  represent  the  jth  row  of  L,  .       V 
-jk'  -jk'  ^  k 

The  dual  of  Theorem  (3.10)  is  now  stated. 

(3.17)  Theorem.   A  triple  (A,Q,d^)   is  a  partial  arbitrary  realization 

T   T       T 
of  a  finite  sequence  (c, ,?«,... ,C.,  1  of  r-dimensional 

—  i  — Z       No 

(row)  vectors  if  and  only  if  p  2l  Nb  . 
Proof.   Follows  by  duality.  V 

Of  all  the  possible  partial  arbitrary  realizations,  that  one  which 
is  minimal  is  the  one  of  greatest  importance  here.   To  this  end,  the 
results  of  Theorems  (3.10)  and  (3.17)  are  combined  into  the  following 
corol lary . 


7A 


(L18)   Corollary.   The  dimension  of  the  minimal  partial  arbitrary  rea- 
lization of  a  (column  or  row)  vector  sequence  of  No 
elements  is  given  by  N(,  . 
Proof.   Follows  readily  from  the  proofs  of  Theorems  (3.10)  and  (3.17).   V 

Notice  that  Theorems  (3.10)  and  (3.17),  as  well  as  Corollary  (3.18), 
include  the  scalar  sequence  case  (m  =  r  =  1)  as  a  special  case. 

A  result  equivalent  to  that  of  Corollary  (3.18)  for  finite  matrix 
sequences  seems  to  be  more  difficult  to  obtain.   This  is  probably  due 
to  the  fact  that  in  the  multiple  input/output  case  the  coefficients  of 
the  characteristic  polynomial  of  A  are  no  longer  equal  to  the  {y        I 
coefficients  but  are  defined  by  these  through  nonlinear  equations,  and 
the  ^Y^-j^}  coefficients   are  determined,  in  turn,  by  the  elements  of  the 
matrix  sequence.   These  sets  of  relations  are  not  easily  expressed  in 
closed  form.   However,  necessary  conditions  and  sufficient  conditions 
for  a  triple  (A,Q,D)   to  be  a  partial  arbitrary  realization  of  a  finite 


ma 


trix  sequence  can  be  stated.   These  are  given  in  the  next  two  theorems. 


(3.19)   Theorem.   Necessary  conditions  for  a  triple  (A,Q,D)   to  be  a 

P 

partial  arbitrary  realization  of  a  finite  sequence 

I'L ,,'L    ,  .  .  .  ^L      }  of  mxr  matrices  are  that 

a)   the  controllability  indices  of  (A,Q,D) 

P 

be  an  admissible  set  of  controllability 
indices,  and 

r   r        r  r 


b)   P  1   I    I  O    -   [  p(M.)  =  o  -   [  p(M.) 
i=l  j  =  l  "-J   i=l   '        i=l   ^ 

where  the  integers  {o..}  are  defined  by  (2.23)  and 

M^  is  defined  in  Step  2  of  Algorithm  (2.78). 
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I'roof.   The  necessity  of  condition  (3.19a)  is  obvious.   Condition  (3.19b) 

is  proved  as  follows. 

Generally,  the  (3,  }  coefficients  are  nonlinear  functions  of  the 
k 

{y  ,  }  coefficients.   Therefore,  in  order  for  A  to  have  arbitrary  eigen- 
ijk 

values  it  is  necessary  that  at  least  p  of  the  {y..,  }  coefficients  be 

'ijk 

arbitrary.   To  obtain  the  {y  .,  }  coefficients  of  a  partial  realization 
of  the  given  sequence,  it  is  necessary  to  solve  an  equation  of  the  form 
(2.79)  for  i  =  l,2,...,r.   The  total  number  of  degrees  of  freedom  (arbi- 
trary parameters)  in  the  solution  to  these  equations  was  found  to  be 
given  by  (2.80)  with  p(M.)  =  0  if  p.  ^  No.   For  the  realization  to  have 
completely  arbitrary  poles,  it  is  necessary  that  p  be  less  than  or  equal 
to  this  number.   This  is  condition  (3.19b).  V 

(3.20)  Remark.   Dual  necessary  conditions  for  a  matrix  triple  to  be  a 
partial  arbitrary  realization  (of  a  given  finite  sequence)  can  be  ob- 
tained by  considering  the  dual  arguments  in  the  proof  of  Theorem  (3.19). 
In  Definition  (2.19)  and  in  Remark  (2.33),  the  dual  of  the  sets  of  in- 
variants {u.}  and  {y...  }  and  of  the  parameters  {a..}  were  defined  to  be 

1        ijk  ij 

{6.1,  (6.   },  and  {k..},  respectively.   Correspondingly,  the  dual  of  the 
1     ijk         ij 

{&  ,  }  (column)  vector  invariants  are  rows  of  the  elements  in  the  given 

matrix  sequence.   As  previously  stated  (see  (3.16))  these  dual  invari- 

T 
ants  will  be  denoted  by  the  set  of  (row)  vectors  (C^.,)- 

J  ^ 

Now  let  {6.,,}  denote  the  set  of  minimal  observability  indices,  and 
iM 

define  an  admissible  set  of  observability  indices  as  {6.  :  6.  >  6_,}, 

■'  1     1  =  iM 

analogous  to  Definitions  (3.5)  and  (3.6).   Also,  define  the  integer  k'  as 

m       mm 

(3.21)  K  =   J  K.  =   J     );  K.. 

i=l  ^    i=l  j=l  ^J 
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and  let  R.  ilenote  the  matrix  corresponding  to  M.  in  the  dual  f  uriTiu  I  a  t  i  on 
I  1 

of  (2.79).   With  these  definitions,  the  dual  of  the  necessary  conditions 
(  i.  I')a)  and  ((.  I')l))  arc  j-.ivcn  as 

a)  the  observability  indices  of  (A,Q,D)   be  an  admissi- 
ble set  of  observability  indices,  and 

m 

b)  p  <  K  -  I    p(R  ) 

1=1 

Using  either  (3.19b)  or  (3.20b)  to  obtain  lower  bounds  for  the  di- 
mension of  the  minimal  partial  arbitrary  realization  of  a  given  matrix 
sequence  should  give  equivalent  results.   However,  this  seems  to  be 
difficult  to  prove.   In  the  sequel,  reference  is  made  mostly  to  (3.19b), 
but  it  should  be  kept  in  mind  that  (3.20b)  is  equally  applicable.       V 

It  is  stressed  that  Theorem  (3.19)  gives  only  necessary  conditions 
for  a  matrix  triple  to  be  a  partial  arbitrary  realization  (of  a  given 
finite  sequence)  of  dimension  equal  to  p.   Equation  (3.19b)  being  satis- 
fied for  a  value  of  p  and  an  admissible  set  {y.}  does  not  imply  that  a 
partial   realization  of  dimension  p  and  structure  determined  by  the  {p.} 
is  a  partial  realization  of  the  given  finite  sequence.   This  is  due  to 
the  fact  that  p  or  more  arbitrary  Y...  coefficients  do  not  (generally) 
guarantee  that  the  p  eigenvalues  of  A  are  arbitrary.   The  theorem  does 
give  the  lowest  possible  value  of  p  and  the  corresponding  admissible 
sets  of  controllability  indices  (notice  that,  for  a  given  value  of  p, 
equation  (3.  19b)  may  be  satisfied  with  more  than  one  admissible  set  of 
controllability  indices)  that  are  suitable  candidates  for  the  dimension 
and  controllability  indices  of  a  minimal  partial  arbitrary  realization 
of  the  given  sequence. 
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The  following  result  states  sufficient  conditions  for  a  matrix  tri- 
ple lo  be  a  partial  arbitrary  realization  of  a  finile  iii.i  t  r  i  x  sofpienci' . 
(3.22)   Theorem.   Sufficient  conditions  for  a  triple  (A,Q,D)   to  be  a 

partial  arbitrary  realization  of  a  finite  sequence 

{L,  ,L^ ,  .  .  .  ,L.,  }  of  mxr  matrices  are  that 
12      No 

a)  the  controllability  indices  of  (A,Q,D)   be 

an  admissible  set  of  controllability  indices, 
and 

b)  p    >   min(rNo  ,mNo  ) 

Proof.   The  proof  is  by  construction.   Let  the  structure  of  a  matrix 
triple  be  determined  by  the  following  set  of  controllability  indices 
{y.  :  y.>  No}.   This  is  an  admissible  set  of  controllability  indices 
because  the  size  of  the  minimal  controllability  indices  is,  at  most, 
equal  to  No.   Clearly,  p  ^  rNo  for  such  a  choice  of  input  structure. 
Consider  now  the  equations  (2.32)  for  a  partial  realization  of  the  given 
sequence  that  has  the  selected  input  structure.   It  is  noticed  that 
since  y  +  1  +  x  >  No  for  all  T  >  0  and  1  £  i  £  r,  then  all  the  vectors 
on  the  left-hand  side  of  (2.32)  and  (possibly)  some  vectors  on  the 
right-hand  side  of  (2.32)  are  unspecified.   Therefore,  the  {y..,}  coef- 
ficients  can  be  chosen  at  will,  and  consequently,  the  eigenvalues  of  A 
are  arbitrary. 

If  the  above  procedure  is  applied  in  dual  context,  it  is  found 
that  a  matrix  sequence  of  No  terms  always  admits  a  partial  realization 
of  dimension  p  >^  mNo  and  arbitrary  poles.   Equation  (3.22b)  follows.    V 

The  results  of  Theorems  (3.19)  and  (3.22)  are  easily  combined  to 
obtain  a  set  of  constraints  that  must  be  satisfied  by  a  matrix  triple 
in  order  to  be  a  minimal  partial  arbitrary  realization  of  a  given  finite 
matrix  sequence.   This  is  the  following  corollary. 
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('3.23)   Corollary.   If  a  triple  (A,Q,D)    is  a  minimal  partial  arhiLiary 

Pa 

realization  of  a  finite  sequence  II  ,),...,!,  \    ot 

1  Z  Nil 

mxr  matrices,  then  its  dimension  and  its  coiiLrol  la- 
bility indices  {y.}  satisfy  the  following  constraints: 
^^   ^i  '^iM  i  =  ^2 r 

r 

b)  Pa  1  cr  -  I    p(M  ) 

^       i=l    ^ 

c)  p  ^  min(rNo ,mNo ) 

where  (M-w)  is  the  set  of  minimal  controllability 
indices  associated  with  the  given  sequence,  a   is 
defined  by  (2.51)  and  (2.23),  and  M.  is  defined 
in  Step  2  of  Algorithm  (2.78). 
Proof.   Follows  readily  from  the  proofs  of  Theorems  (3.19)  and  (3.22).   V 
(3.24)   Remark.   It  is  easy  to  show  that  constraints  (3.23b)  and  (3.23c) 
are  equal  to  each  other,  and  in  turn,  equal  to  No  whenever  r  =  1  and/or 
m  =  1,  and  p  =  No  is  the  chosen  admissible  controllability  index.   Thus, 
Corollary  (3.18)  is  a  special  case  of  Corollary  (3.23).  V 

Corollary  (3.23)  is  more  significant  than  what  appears  at  first 
glance.   It  gives  upper  and  lower  bounds  for  p   and  all  the  possible 
corresponding  sets  of  admissible  controllability  indices.  (Constraint 
(3.23c)  is  obviously  an  upper  bound,  and  even  though  (3.23b)  looks  like 
an  upper  bound  also,  it  is  actually  a  lower  bound;  this  is  discussed  in 
length  later  on.)   Notice  that  constraints  (3.23a)  and  (3.23c)  are 
easily  verified  for  a  given  matrix  triple  and  a  given  matrix  sequence, 
but  (3.23b)  requires  (in  general)  the  computation  of  the  rank  of  r  ma- 
trices.  The  minimal  partial  arbitrary  realization  algorithm  that  appears 
in  the  next  section  is  based  on  the  constraints  specified  in  the  above 
corollary. 
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'I'Ik'SC  rosiiHs  sIk^w  that  every  fLnite  matrix  sequcnro  admits  a 
minimal  arbitrary  extension  sequence,  and  give  bounds  for  the  tlLmension 
of  the  minimal  partial  arbitrary  realization.   It  follows  that  every 
finite  matrix  sequence  admits  infinitely  many  extension  sequences  and 
has  infinitely  many  partial  stable  realizations  (construct  any  partial 
arbitrary  realization  and  select  stable  poles  for  it).   Then  there  exists 
at  least  one  realization  of  minimal  dimension  among  all  the  partial  sta- 
ble realizations.   This  minimal  realization  (or  realization,  if  not 
unique)  is  the  one  of  primary  importance  in  this  dissertation. 

At  this  point,  it  should  be  intuitively  clear  that  a  partial  stable 
realization  which  is  obtained  by  specifying  stable  poles  in  a  partial 
arbitrary  realization  is  not  (generally)  minimal;  the  minimal  partial 
stable  realization  is  expected  to  have  dimension  larger  than  p   but 
smaller  than  p  .   Given  a  finite  matrix  sequence,  it  is  not  too  diffi- 

Pi. 

cult  to  calculate  the  value  of  p,.  (see  (2,12))  and  (strong  bounds  for) 

M 

the  value  of  p   (see  Corollary  (3.23)).   Unfortunately,  it  seems  to  be 
quite  difficult  to  state  analogous  results  for  the  value  of  p  .   This 
is  probably  due  to  the  fact  that  the  stability  of  a  realization  is  deter- 
mined exclusively  by  the  factors  of  the  characteristic  polynomial  of  A 
(the  eigenvalues  of  A),  and  the  elements  of  A  (assuming  A  to  be  in  the 
form  (2. 55)-(2. 57) )  that  determine  its  characteristic  polynomial  are 
specified  by  the  elements  of  the  given  sequence  via  formulas  that  are 
not  easily  expressed  in  closed  form.   Further,  stability  is  normally 
determined  from  the  characteristic  polynomial  coefficients  using  the 
well-known  Routh-Hurwitz  criterion  (see,  for  example,  Gantmacher,  1959, 
Vol.  2),  and  this  procedure  relates  the  coefficients  in  a  fashion  that 
is  not  easily  expressed  in  closed  form  either.   In  other  words,  even 
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though  there  is  no  doubt  that  every  finite  matrix  sequence  has  a  minimal 
partial  stable  realization,  it  seems  to  be  difficult  to  state  a  result 
for  the  value  of  p   as  strong  as  Corollary  (3.23)  for  p  . 

On  the  other  hand,  it  is  possible  to  state  some  simple  necessary 
conditons  that  must  be  satisfied  by  a  system  (2.1)  in  order  to  be  a  par- 
tial stable  realization  of  a  finite  matrix  sequence.   These  conditions 
are  stated  and  proved  for  the  vector  sequence  case  and  then  for  the 
matrix  sequence  case.   But  first  it  is  convenient  to  define  the  follow- 


ing matrices.   Let  B      be  the  following  mrxp  matrix 


(3.25) 


B     = 
P 


^11 


-21 


-12 


-22 


-Ip 

-2p 


-rp 


-pl 
-p2 


-pr 


and  let  G     be  the  following  pxmr  matrix 


(3.26) 


^11 

^21 

•    •      -^1 

-^12 

-22 

•    •      ^2 

G     = 
P 

• 

• 
• 

• 

-Ip 

-2p      • 

— mp 

%l       ^2    ■    ■    ■   V 


where  i..    and  C,  are  as  previously  defined.   When  r  =  1,  S  becomes 
-jk     -jk        f                   J  .   p 

T 

b    ,    a   single  (block)  row;  likewise,  when  m  =  1,  G  becomes  a,   a 


%' 


single  (block)  column. 


(3.27)   Theorem.   Necessary  conditions  for  a  triple  (A.^^.D)   with 

Pw  4  p  <^  No  -  1  to  be  a  partial  stable  realization 


of  a  finite  sequence  {!i,  ,!i^,  .  .  .  ,L,    }  of  m-dimensional 

i   Z     — No 
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((.•olumn)    vi'iliirs    art'    that 


T  T 

a)      r>(b    )    =   p(b        )  ,    and 


T 
b)   every  non-zero  row  of  Z?  ,  ,  have  two  or  more 
-'  —p+1 

elements  with  different  sign. 
Proof.   The  bounds  on  p  follow  fiom  the  definition  of  p   and  from  Theorem 
(3.10).   As  in  the  proof  of  Theorem  (3.10),  equation  (2.32)  reduces  to 
(3.11)  when  r  =  1.   This  equation  must  be  satisfied  (for  some  (B,  1)  for 
the  sequence  to  admit  a  partial  realization  of  dimension  p.   Notice  that 
condition  (3.27a)  is  another  form  for  (3.11)  with  T  =  0.   This  proves 
necessity  of  (3.27a). 

Suppose  now  that  (3.27a)  is  satisfied  for  some  value  of  p  in  the 
specified  range.  The  scalars  (6,  }  that  determine  the  relation  (3.11) 
are  the  coefficients  of  the  characteristic  polynomial  of  A.  In  order 
for  A  to  have  all  its  eigenvalues  in  the  left-half  of  the  s-plane,  it 
is  necessary  that  all  the  (6,  )  coefficients  be  positive  (this  is  a  well- 
known  result  in  the  theory  of  polynomials).   It  is  easy  to  see  that  at 

least  one  of  these  coefficients  is  negative  if  all  the  elements  in  any 

T 
non-zero  row  of   b    , ,    have  the  same  sign.   This  proves  necessity  of 
—p+1 

(3.27b).  ' 

The  dual  of  the  above  result  is  now  stated. 
(3.28)   Theorem.   Necessary  conditions  for  a  triple  (A,Q,d)   with 

p  ^  p  ^  No  -  1  to  be  a  partial  stable  realization 

T   T       T 
of  a  finite  sequence  {?,,?„,.,.  ,C.,  }  of  r-dimensional 

— 1  — Z  "tMo 

(row)  vectors  are  that 


a)  P(£p)  =  P^^+i^  '  ^^'^ 

b)  every  non-zero  column  of  ?  . ,  have  two  or 

^  *^+l 

more  elements  with  different  sign. 
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Proof.   Follows  by  duality.  V 

Notice  that  Theorems  (3.27)  and  (3.28)  include  the  scalar  sequence 

case  (m  =  r  =  1)  as  a  special  case. 

Necessary  conditions  analogous  to  those  given  above  can  be  obtained 

for  the  matrix  sequence  case  with  the  aid  of  the  following  lemma  due  to 

Ho  and  Kalman  (1966).   The  simple  proof  is  omitted. 

(3.29)  Lemma.   The  elements  of  an  infinite  sequence  {L  ,L  ,...}  of 

mxr  matrices  which  admits  a  finite-dimensional  realiza- 
tion (2.1)  satisfy  the  following  relation 

(3.30)  Vl+T  =  -  J/k\+T  T  =  0.1,2,... 

k=l 

Further,  if  the  degree  of  the  minimal  polynomial  of  A 
is  smaller  than  p,  then  (3.30)  is  also  satisfied  with 
p  replaced  by  the  degree  of  the  minimal  polynomial  of  A 
and  the  (B.  }  replaced  by  the  coefficients  of  the  mini- 
mal polynomial  of  A. 
Now  the  matrix  sequence  version  of  Theorems  (3.27)  and  (3.28)  can 
be  stated. 

(3.31)  Theorem.   Necessary  conditons  for  a  triple  (A,Q,D)   with  p  ^  p„ 

to  be  a  partial  stable  realization  of  a  finite  sequence 
{L  ,L  , ...,L^  }  of  mxr  matrices  are  that 

a)  p(S  )  =  P(S  .,),  and 

P       P+1 

b)  every  non-zero  row  of  S  , ,  have  two  or  more 

p+1 

elements  with  different  sign. 
Proof.   Follows  the  pattern  of  the  proof  of  Theorem  (3.27)  except  that 
(3.30)  is  used  rather  than  (3.11).  V 
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■riu'oriMii    (3.  H)    n  1  so    has    a    tlual    resulL;     ils    lonii    sluiulil    lu-    olivicuis 
and    is   not    given   here.      For   brevity,    the    dual    approach    is   not    considered 
any    Tiirthc'r    in    this   chapter. 

Notice  that  Theorem  (3.27)  is  a  special  case  of  Theorem  (3.31). 
However,  a  situation  can  arise  in  the  partial  matrix  sequence  case  that 
never  occurs  in  the  partial  vector  sequence  case.   This  is  discussed 
after  the  following  definition. 

(3.32)  Definition.   Matrix  A  is  said  to  be  cyclic  if  and  only  if  any 

one  of  the  following  equivalent  conditions  is  sat- 
isfied. 

a)  The  minimal  polynomial  and  the  character- 
istic polynomial  of  A  are  equal  to  each 
other. 

b)  The  Jordan  form  of  A  (see,  for  example, 
Gantmacher,  1959,  Vol.  1)  has  only  one 
Jordan  block  corresponding  to  every  dis- 
tinct eigenvalue  of  A. 

c)  There  exists  a  p-dimensional  vector  ^  such 
that  (A,£^)   is  a  completely  controllable 
pair. 

By  a  slight  abuse  of  notation,  system  (2.1)  is 
also  called  cyclic  if  matrix  A  is  cyclic. 
In  the  analysis  and  design  of  systems  of  the  form  (2.1),  cyclicity 

is  a  very  convenient  (but  by  no  means  necessary)  property.   The  same 

holds  true  in  realization  theory, 

(3.33)  Remark.   It  follows  from  (3.32c)  that  a  completely  controllable 
single  input  system  is  always  cyclic.   As  a  consequence,  it  is  true  that 
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T       ,  T 
i'(h^)    =  ('(^^^_^_^)    if  and  only  if  k  >  p^^  in  the  partial  (column)  vector 

scMiticncr  case.   When  the  system  lias  more  than  one  iiipul,  it  is  no  lony.er 
true  tliat  complete  controllability  implies  cyclicity.   Consequently, 
in  the  partial  matrix  sequence  case  k  >  p^  still  implies  p(5  )    =    o(B        ) 
but  p(B^)    =   P(5j^^j)  no  longer  implies  k  >  p^^  (if  condition  (3.32a)  is 
not  true,  then  (3.30)  is  satisfied  for  some  P  <  Pj^)  •   Simon  and  Mitter 
(1968)  have  discussed  extensively  the  question  of  complete  controlla- 
bility of  cyclic  and  noncyclic  systems. 

The  above  discussion  involves  a  subtle  but  significant  point:   the 
fact  that  complete  controllability  does  not  imply  cyclicity  in  the  multi- 
ple input  case  renders  condition  (3.31a)  less  useful  than  conditon 
(3.27a)  in  the  single  input  case.   More  specifically,  given  a  finte 

(column)  vector  sequence,  p^   is  equal  to  the  smallest  integer  k  such  that 

T       T 
P(^^)  =  PC^k+i).  but  if  a  finite  matrix  sequence  is  given  instead,  then 

Pm  is  not  generally  equal  to  the  smallest  integer  k  such  that  p(B  )  = 

(3.  34)   Remark.   The  results  presented  in  this  section  can  be  used  to 
state  several  conditions  under  which  equality  or  inequality  holds  in 
(3.4).   For  example,  if  p^^  =  min(rNo  .mNo ) ,  then  P^  =  Pg  =  p^^;  or,  if  the 
minimal  partial  realization  is  unstable  and  Pj^  +  1  =  min  (rNo  ,mNo  )  ,  then 
''a  "  Ps  "  Pm  "^  ^-  ^°^^  °^   these  conditions  could  be  stated,  but  it  is 
not  enlightening  because  of  their  data-dependent  nature.   In  other 
words,  everything  centers  on  the  value  of  p^^  and  the  number  of  arbitrary 
parameters  in  the  minimal  partial  realization,  and  these  are  determined 
exclusively  by  the  elements  of  the  given  sequence.   Further,  all  that  is 
needed  to  recognize  these  special  cases  is  some  familiarity  with  the  re- 
sults stated  in  Corollary  (3.23)  and  in  Theorem  (3.31).  V 
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Partial  Realization  Algorithms 
Tin-  theory  presontod  nhovo  and  in  Chapter  2  is  used  h.^re  to  d.^vc'lop 
procedures  to  solve  the  minimal  partial  stable  and  the  minimal  partial 
arbitrary  realization  problems.   Unlike  Algorithm  (2.78),  the  algorithms 
presented  here  are  of  iterative  nature.   This  is  a  consequence  of  the 
difficulties  encountered  in  relating  the  elements  of  a  finite  matrix 
sequence  to  the  coefficients  of  a  stable  or  arbitrary  polynomial  of  a 
specific  degree,  and  the  host  of  possible  situations  that  arise  in  the 
construction  of  non-minimal  partial  realizations  (see  Remark  (3.35) 
below). 

When  the  given  partial  sequence  is  composed  of  vectors  rather  than 
matrices,  it  is  considerably  simpler  to  obtain  the  minimal  partial  stable 
and  the  minimal  partial  arbitrary  realizations.   But  the  algorithms  are 
discussed  for  the  matrix  case  only  since  the  simplifications  that  are 
possible  in  the  vector  case  are  obvious. 

(3.35)   Remark.   As  mentioned  above,  the  construction  of  non-minimal 
partial  realizations  of  a  specified  dimension  and  other  desirable  pro- 
perties  is  not  any  easy  problem.   Several  difficulties  that  do  not  arise 
in  the  construction  of  minimal  partial  realizations  are  intrinsic  prob- 
lems in  the  construction  of  non-minimal  partial  realizations. 

Recall  that  all  minimal  realizations  of  a  partial  matrix  sequence 
have  the  same  controllability  indices  and  are  completely  controllable 
and  observable.   Such  is  not  necessarily  the  case  with  non-minimal  par- 
tial realizations.   There  (generally)  exist  non-minimal  partial  realiza- 
tions of  the  same  dimension  but  with  different  sets  of  controllability 
indices.   Also,  it  is  possible  that  a  completely  controllable  non-minimal 
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partial  realization  is  unobservable.   In  fact,  the  lollowinj;  s  i  tu.il  U'lis 
(.iiiioii)',  ollicrs)  c:\\)    (urur  in  t  lit'  non-mi  n  i  ni.i  1  p.irli.il  rcM  1  i  ;-,.i  t  i  on  >)  loli  1  <ni. 

a)  Some  reali  7.aL  ions  with  i-mit  rol  1  ali  i  1  i  l  \'  imlicos 
lu.}  ^  M(p)  are  completely  observable  while  oLiier 
realizations  with  the  same  controllability  indices 
are  unobservable. 

b)  All  (or  some)  realizations  with  controllability 
indices  {y.}.  ^  M(p)  are  completely  observable  while 
all  (or  some)  realizations  with  controllability 
indices  {y.},  ^  M(p)  for  j  /  k,  are  unobservable. 

1  K 

c)  All  realizations  of  dimension  p  are  unobservable. 
Here  {[}.}.    denotes  the  jth  element  of  M(p);  also,  it  is  assumed  that 

p  '  P   +1.   The  occurrence  of  (3. 35a)-(3. 35c)  is  explained  next. 

M 

Suppose  that  a  finite  matrix  sequence  is  given,  together  with  its 

minimal  realization  (of  dimension  p. J .   For  the  moment,  assume  the 

M 

minimal  realization  is  unique.   Now  obtain  the  corresponding  minimal  ex- 
tension sequence  using  (2.32).   Suppose  now  that  one  or  more  of  the  ele- 
ments of  the  minimal  extension  sequence  is  altered  in  a  random  fashion. 
Since  the  minimal  extension  sequence  is  unique,  such  an  action  forces 
the  dimension  of  the  minimal  realization  of  the  modified  (complete)  se- 
quence to  be  larger  than  p  .   This  is  a  consequence  of  the  disruption  of 
existing  linear  dependencies  among  the  columns  of  M.   The  first  p  linearly 

independent  columns  of  K,  »,   determine  the  minimal  controllability  in- 

No  No 

dices,  so  the  least  increase  in  dimension  should  occur  when  only  the 
first  elements  of  the  minimal  extension  sequence  are  altered.   Further- 
more, whether  the  increase  in  dimension  is  large  or  small  depends  on 
tlie  type  and  amount  of  alterations  done  to  the  minimal  extension  sequence. 
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ami  it  is  conceivable  (and  indeed  true)  that  for  some  sequences  even 
the  slightest  changes  done  to  the  first  few  elements  of  the  minimal  ex- 
tension sequence  cause  an  increase  in  dimension  of  2  or  more  (from  p   to 
p   +  k,  k^2).  When  the  minimal  realization  of  the  given  finite  sequence 
is  not  unique,  the  minimal  extension  sequence  is  not  unique.   The  pre- 
ceding arguments  also  apply  to  this  case  with  the  observation  that  some 
specific  alterations  done  to  any  particular  minimal  extension  sequence 
do  not  increase  the  dimension  of  the  minimal  realization  of  the  modified 
(complete)  sequence. 

The  occurrence  of  (3. 35a)- (3. 35c)  can  also  be  explained  from  the 
point  of  view  of  the  structural  parameters  of  a  non-minimal  realization. 
It  has  been  shown  that  a  non-minimal  realization  has  more  arbitrary 
parameters  than  a  minimal  realization  of  the  same  sequence.   Also,  as 

stated  in  Remark  (2.58),  the  parameters  {y..,  }  in  A  and  the  vectors  {£.,  } 

ijk  -jk 

which  comprise  the  columns  of  D  must  jointly  satisfy  the  condition  that 

(A,D)   be  a  completely  observable  pair.   When  p  =  p  ,  the  realization 

will  always  be  observable  for  all  possible  values  of  all  the  arbitrary 

Y...  parameters:  but  when  p  >  p„,  the  realization  can  be  unobservable 
ijk  M 

for  some  or  all  possible  values  of  all  the  arbitrary  Y..,  parameters.    V 

Algorithm  (2.78)  gives  all  the  possible  minimal  realizations  of  a 
partial  matrix  sequence  at  once  (solving  equations  (2.79)  one  time  only), 
because  the  set  of  minimal  controllability  indices  is  unique.   But  to 
obtain  all  possible  non-minimal  realizations  of  specified  dimension  of 
a  partial  matrix  sequence  (generally)  requires  solving  equations  of  the 
form  (2.79)  several  times,  and  it  is  also  necessary  to  verify  whether 
the  realizations  are  observable  or  not.   Likewise,  to  obtain  all  possi- 
ble stable  or  arbitrary  realizations  of  a  partial  matrix  sequence  it  is 
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(ficnerally)  necessary  to  solve  several  sets  of  equations  of  the  form 
(2.79),  verify  the  observability  of  the  realizations,  and   furtlier,  the 

st.iliility  or  arbitrariness  of  the  realizations  also  has  to  be  vorifiL-d. 

These  are  the  basic  ideas  involved  in  the  partial  realization  algorithms 

presented  in  the  sequel. 

Before  discussing  the  minimal  partial  stable  and  arbitrary  realiza- 
tion algorithms,  a  non-minimal  partial  realization  algorithm  that  can  be 
used  to  obtain  all  the  possible  realizations  of  specified  dimension 
P  ^  Pj,j  of  a  given  finite  matrix  sequence  is  presented.   This  algorithm 
is  the  most  important  part  of  each  iteration  in  the  minimal  partial 
stable  and  minimal  partial  arbitrary  realization  algorithms,  besides 
being  of  interest  in  its  own  right.   It  is  assumed  that  the  minimal  set 
of  controllability  indices  (and,  consequently,  M(p))  is  known  and  given 
as  an  input  to  the  algorithm. 
(3.36)   Non-minimal  Partial  Realization  Algorithm. 

^"^^P  ^-   ^o'^'"  the  truncated  generalized  Hankel  matrix  TC     (the  upper 

No  No 

left-hand  corner  of  (2.11)).   Choose  one  set  of  admissible 
controllability  indices  in  M(p) . 
^t^P  ^-   Form  the  following  mNo xp  matrix 

and  define  M.  as  the  m(No-M.)xp  top  portion  of  L. 
^"^^P  ^-   According  to  the  desired  input  structure, 

-ip.  +  l     "i^i  1  =  1,2, r 

where  the  hat  C)    over  M   indicates  that  some  columns  of  M 

i 
are  not  generally  included,  and  ^.^^^  is  the  m(N„-M.)  top 

portion  of  h        _^^.      Solve  (3.38)  for  i  =  l,2,....r  to  obtain 
1 
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Step  4. 


Step  5. 


(3.39) 


the  rc'.il  izntion  parameters  ij .       1 .       Notice  that  there  will 

•  1  '^ 

.ilwavs    he    some    arhiLrary    "y  .  because     i  nc  reas  i  ii-    oik-    oi     mor.' 

1  )K 

of  the  minimal  controllability  indices  forces  equation  (3.38) 

to  have  more  unknowns  than   equations  for  one  or  more  values 

of  i.   That  is,  as  p^^  is  increased  to  M.j^  +  1,  M.  has  m  less 

rows  while  the  number  of  unknowns  has  increased  by  one  (at 

least  for  i  =  j).    In  the  extreme,  y .  >  No  makes  M.  be  unde- 

1  —  1 

fined  and,  therefore,  y_.    is  arbitrary. 

A  partial  realization  of  dimension  p  can  be  constructed  in  the 

form  (2.55)-(2.57)  with  the  {y  }  and  {y..,}  parameters  of 

1        ijk 

Steps  1  and  3,  and  the  p  m-dimensional  vectors  that  make  up  the 
first  block  row  of  L. 

Form  the  m(p-m+l)xp  observability  matrix 
D 


0   = 


DA 


and  compute  its  rank.   The  realization  is  completely  observable 
if  and  only  if  p(5)  =  p.   In  (3.39)  it  has  been  implicitly 
assumed  that  D  has  full  rank.   If  such  is  not  the  case,  then 
0   has  to  be  extended  to  include  up  to  the  p  -  1  power  of  A. 
^"^"^P  ^-   Repeat  Steps  2-5  for  a  different  set  of  admissible  controlla- 
bility indices  in  M(p).   This  is  continued  until  all  the  ele- 
ments of  M(p)  are  considered. 
Proof.   This  algorithm  is  closely  related  to  Algorithm  (2.78),  and  the 
proof  follows  that  of  Algorithm  (2.78)  with  two  modifications  to  account 
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for  the  differences  that  exist  between  the  minimal  and  non-minimal  par- 
tial realization  problems  (see  Remark  (3.35)). 

The  modifications  are  the  following.   First,  since  it  is  possible 
that  there  exist  several  non-minimal  realizations  of  the  same  dimension 
but  with  different  sets  of  controllability  indices,  then  every  admissi- 
ble set  of  controllability  indices  that  add  up  to  p  could  possibly  de- 
fine the  structure  of  a  valid  (controllable  and  observable)  realization 
and  must  be  taken  into  account.   This  is  taken  care  of  by  considering 
every  set  of  controllability  indices  in  M(p).   Second,  while  all  matrix 
pairs  (A,Q)p  of  the  form  (2. 55)- (2. 56)  are  (trivially)  completely  con- 
trollable, the  observability  of  a  matrix  pair  (A,D)   of  the  form  (2  SS")  - 

p  ^      .  —  J 

(2.57)  depends  on  the  values  of  the  parameters  {y   ,  }  in  A  and  on  the 
columns  of  D.   Therefore,  the  observability  of  the  realization  is  in- 
vestigated in  Step  5.  V 

The  need  for  Step  5  in  Algorithm  (3.36)  is  evident  once  it  is  rea- 
lized that  the  situations  described  in  Remark  (3.35)  indeed  occur  (es- 
pecially when  the  dimension  of  the  desired  partial  realization  is 
slightly  larger  than  p^^) .   The  following  two  examples  illustrate  the 
application  of  Algorithm  (3.36)  and  the  occurrence  of  situations  (3.35b) 
and  (3.35c). 

(3.40)   Example.   Consider  the  following  partial  matrix  sequence. 


1 


1 

0 

-1 

1 

h- 

1 


s  = 


-1 


1  -1 

-1  2 

The  minimal  realization  (obtained  using  Algorithm  (2.78)  is  unique,  and 
is  given  by  the  triple 


A  = 


Q  = 


1     0 
0    1 


D  = 


1    0 
-1     1 


It  is  desired  to  construct  all  partial  realizations  of  dimension  p  =  3. 
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The    SGL    M(3)    ronsists   of    f2,ll    and  {] , 2 } .      The   Hankel    nrray    for    t he 
j^ivLMi    finite   matrix   sequence    is 


Jf. 


33 


0 

1 

-1 

1 

-2 

1 

-1 

2 

-1 

3 

-1 

1 

-2 

* 

A 

2 

-1 

3 

A 

A 

-2 

* 

* 

A 

A 

3 

A 

A 

A 

A 

Consider  first  the  set  of  controllability  indices  {2,1}.   The  cor- 
responding matrix  L  is 

and  the  equations  for  the  {y. .,  }  parameters  are 

ijk 


1 
-1 


1 
-1 


1 
-1 


0 
1 


111 


112 


Y 


121 


-1 

1 

1 

0 

2 

-1 

-1 

1 

-2 

1 

1 

-1 

3 

-1  , 

-1 

2 

'211 


'212 


221 


Notice  that  there  is  one  degree  of  freedom  in  each  set  of  equations.  The 
parameters  Y,,2  ^"^  ^?\2   ^^"^   ^^  selected  as  the  arbitrary  variables. 
Then  the  remaining  four  parameters  are  obtained  as 


Y 


111 


-  1  -  Y 


112 


'211 


1  -  Y 


212 


^121  =  ° 


^221    ^ 


All  partial  realizations  of  dimension  equal  to  three  and  controllability 
indices  {2,1}  are  represented  by  the  triple 
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A  = 


^112-   -1-^^212 


-Y 


112 
0 


-Y 


212 


Q  = 


1  0 
0  0 
0    1 


D  = 


I 


1 


-1 


0 
1 


0   = 


1 

1 

-1 

-1 

1 

1 

-1 

-1 

where  Yjj2  ^"^  ^212  ^"^^   arbitrary.   The  observability  matrix  (3.39)  of 
this  triple  is 

^  o' 

1 

-1 

2 

wliich  has  rank  equal  to  two  (by  inspection).   Thus,  all  possible  reali- 
zations with  this  input  structure  are  unobservable .   It  is  easy  to  veri- 
fy that  the  unobservable  pole  is  at  -1-Y 

Con:3ider  now  the  set  of  controllability  indices  {1,2}.   Matrix  L 
for  this  case  is  given  by 

L  =  tZ^H   ^21   ^22^ 
and  the  parameters  (y^^j^)  are  obtained  by  solving  the  following  equations; 

'ill 
'l21 


1 

1            0 

-1 

-1             1 

1 

1          -1 

-1 

-1             2 

-2 

r,     0 

3 

-1         1 

_           _ 

^^ 

p       — 

^211 

^221 

Y222 

.^                 _ 
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'I'lu'  solution  to  these  equations  is  given  by 


'111 
^121  =  « 


'211 


2  +  T 


Y 


221 


222 
1  -  Y 


222 


wiLli  y..rjr,    arbitrary.   All  possible  partial  realizations  of  dimension 
equal  to  three  and  controllability  indices  {1,2}  are  represented  by 
the  triple 


A  = 


1 


0    -2-Y 


222 


0    0 


0    1 


1+Y 


222 


D  = 


0 
1 


-Y 

-f 

2 


222 


1  0 
0  1 
0    1 


with  Y999  completely  arbitrary.   The  observability  matrix  (3.39)  for 
ttie  above  realization  is  given  by 

1    0   -1" 


0  = 


-1 

1 

2 

1 

-1 

-2 

-1 

2 

3 

It  is  readily  verified  that  0   has  rank  equal  to  two;  therefore,  the 
realization  is  unobservable  for  all  values  of  y      ^.      The  unobservable 
pole  is  found  to  be  at  -l-y      „.      Thus,  all  partial  realizations  of  di- 
mension p  =  3  are  unobservable. 

It  can  be  verified  that  partial  realizations  of  dimension  equal  to 
four  do  exist.   In  fact,  there  are  completely  controllable  and  observa- 
ble realizations  for  every  one  of  the  three  elements  of  Af(4).   All  re- 
alizations of  dimension  p  =  4  and  input  structure  {2,2}  are  represented 
by  the  triple 
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1+Y,12-^122     0    -2+^212-^222' 


-Y 


112 


I) 
0 


^122 


-Y 


U  = 


1 
-1 


122 

0  -1' 

1  2 


0 
0 
1 


^212 

l  +  V 
*222 


-Y 


222 


0 


1 
0 
0 
0 


wl'^re  7j^2'  Yj22'  ^2^2'  ^nd  Y222  ^^^  arbitrary.   It  is  easy  to  verify 
thnt  any  such  realization  is  completely  observable  if  and  only  if 
^122  ^  0- 
(3.41)   Example.   Consider  the  following  partial  matrix  sequence 


^1  = 


0 
1 
0 


0 

1 

~1 

0 

0 

1 

s  = 

0 

1 

1 

-1 

1 

-1 

Its  minimal  realization  (obtained  using  Algorithm  (2.78))  is  unique, 
has  dimension  p^^  =  3,  and  controllability  indices  (p^  ,u  )  =  {2,1}. 
It  is  given  by  the  triple 


A  = 


0  1 

1  1 
0    0 


1 

-1 
1 


1  0 
0  0 
0    1 


1    0    0 
D  =   0    0    1 
0    1    0 
U  is  desired  to  construct  all  partial  realizations  of  dimension  p  =  4. 

■ITie  set  M(4)  contains  only  two  elements:  {2,2}  and  {3,1}.   The 
Hankel  array  corresponding  to  the  given  sequence  is 
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7C_ 


33 


1 

0 

0 

1 

1 

0 

1 

0 

1 

0 

0 

0 

1 

-1 

1 

0 

1 

1 

0 

* 

0 

1 

0 

1 

* 

1 

-1 

1 

-1 

* 

1 

0 

* 

* 

* 

0 

1 

* 

■k 

* 

1 

-1 

* 

* 

A 

0 

1 
-1 


Consider  first  the  set  of  controllability  indices  {2,2}. 
choice  of  controllability  indices,  matrix  L  is  given  by 

L  =  [Au   hi        hi        hl^ 
and  the  corresponding  equations  (3.38)  are 

1 

0 

1 


For  this 


1 

0 

0 

1 

0 

0 

1 

1 

0 

1 

0 

-1 

111 


Y 


112 


T 


121 
""^122 


0 

1 

•1 


1    0    0 
0    0    1 

1 


0 


0   -1 


Y 


Y 


211 


212 
"^221 
Y222 


There  is  a  total  of  2  degrees  of  freedom  in  the  above  sets  of  equations. 
^^'^  ^122  ^""^  ^222  ^^  ^^^    ^^^^  parameters.   Then, 


111 


112 


-  1  -  Y 


122 


^211   "^222 


1  +Y 


122 


y 


^121   ^122 


212 


'221 


1  +  Y 


222 

1  -  Y 

222 
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AH  (completely  controllable)  realizations  with  controllability  indices 
(2,2}  are  represented  by  the  triple 


1+Y 
1-Y 


122 


A  = 


122 


Y 


122 


-Y 


D  = 


122 

1    0    0  l' 

0    0    1  1 

0    1    0  -1 


0 

Y222 

~1 

0~ 

0 

-1-Y222 

0 

0 

0 

1+Y222 

Q  = 

0 

1 

1 

-Y222 

0 

0 

where  y ^^^    and  y^^^   are  arbitrary.   The  observability  matrix  (3.39)  of 
this  realization  is  given  by  (after  some  simple  row  operations) 


0   = 


1 

0 

0 

1~ 

0 

1 

0 

-1 

0 

0 

1 

1 

0 

0 

0 

-2 

0 

0 

0 

0 

_0 

0 

0 

0 

».»ri.  0   Has  5„U  .an.,  so  all  ..e  realisations  of  dimension  .  and  con- 
^roUahlUty  indices  f2,2,  are  completely  controllable  and  observable. 
It  can  fnrcher  be  verified  ebat  all  of  these  realizations  are  unstable. 

Consider  now  the  set  of  controllability  Indices  (3,1).   since 
I'l  -  N„,  the  matrix  A^   u   undefined  and  the  vector 

^1  "  '^ni   1-112   --,,3   Yj2,) 

IS  arbitrary.   Also   n   -  ,, 

so,    U2  -  P2M'  so   ^2  IS  the  same  as  in  the  minimal  reali- 
zat  ion: 

T  ^ 
^2  =  l>'211    Y212    Y221J  =  f-^    i    -1] 
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'i'lien ,  all  (completely  controllable)  realizations  with  controllability 
Liulices  (3,11  are  represented  by  the  triple 


A  = 


0  0  -Y 


0  -Y 


0  1 


-Y 


0  0  -Y 


111 


112 


113 


121 


1 

-1 

0 

1 


Q  = 


1 

6~ 

0 

0 

0 

0 

0 

1 

^ 

10  10 

D  =        0  0  0  1 

0  110 

Matrix  0   is  constructed  next.   After  a  few  simple  row  operations,  it 
is  given  by 


0   = 


1 

0 

0 

1 

0 

0 

0 

0 

0 

0 

0 

0 

-Y 


121 


1 

0 

1 

0 

0 

1 

1 

1 

1 

I 

2 

-1 

^111  ^113  ^ 
"^112"^113" 


0   has  full  rank  if  and  only  if  any  one  of  the  following  three  conditions 
is  satisfied 

^121  ^  ° 

^111-^^113''-  ' 

^-112-^^113  '^  -  2 
In  other  words,  the  values  of  the  elements  of  the  vector  Y,  that  do  not 
meet  the  above  requirements  produce  an  unobservable  realization.   It 
can  be  verified  that  the  four  arbitrary  parameters  in  this  realization 
are  not  sufficient  to  produce  completely  arbitrary  or  even  stable  poles 
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(Lh.it  is,  all  completely  controllable  and  observable  realizations  with 

controllability  indices  {3,1}  are  unstable).  V 

The  .1  I  j',o|- i  1  Inn  outlinrd  hrlow  j'.ivcs  all  I  lie  iiiiiiiiii.il  |i.iili.il  .•.l.ililc 

realizations  of  a  given  sequence.   It  consists  basically  of  applying 

Algorithm  (3.36)  several  times. 

(3.42)   Minimal  Partial  Stable  Realization  Algorithm. 

Step  I.   Compute  the  minimal  partial  realization  (realizations,  if 

non-unique)  of  the  given  sequence  using  Algorithm  (2.78),  and 

check  (by  any  convenient  means)  whether  it  is  stable  (any  are 

stable,  if  non-unique).   If  any  realization  of  dimension  p   is 

stable,  the  minimal  partial  stable  realization  problem  has 

been  solved  and  there  is  no  need  to  continue  the  procedure. 

Otherwise,  proceed  to  the  next  step. 

Step  2.   Find  the  smallest  value  of  p  >  p^,  +  1  for  which  condition 

=  M 

(3.31b)  is  satisfied. 

Step  3.   Form  the  set  M(p)  and  use  Algorithm  (3.36)  to  obtain  all  par- 
tial realizations  of  dimension  p. 

Step  4.   If  partial  realizations  of  dimension  p  do  not  exist,  increase  p 
by  one  and  repeat  Step  3.   Otherwise,  proceed  in  a  systematic 
manner  to  check  (by  any  convenient  means)  whether  the  completely 
controllable  and  observable  realizations  of  dimension  p  are 
stable  or  not.   If  any  of  these  realizations  is  found  to  be 
stable,  the  procedure  is  finished.   Otherwise,  increase  p  by 
one  and  repeat  Step  3. 

Proof.   The  proof  is  obvious.  V 

Often,  only  one  minimal  stable  realization  is  required.   Such  may 

be  the  case,  for  example,  in  the  application  of  partial  realization 

theory  to  the  design  of  minimal  order  observers  (discussed  in  the  next 
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(h.tpter)  .   Tn  these  cases,  the  prohlem  is  often  simplified  because  one 
c.in  choose  the  most  convenient  set  of  controllability  indices  in  M(p) 
1(11"  tlic  input  structure  ol  Lhe  rca  I  IzaL  i  on .   This  is  i  1  I  nsl  ra  Lid  hi  lIk' 
following  example,  which  appeared  in  a  paper  by  Tether  (1970). 
(3.43)   Example.   It  is  desired  to  obtain  a  minimal  partial  stable  rea- 
lization for  the  following  sequence 

^"4     3 
0    0 


1 

1 

h  = 

0 

0 

~22 

15 

\  = 

3 

3 

10 

7 

s  = 

1 

1 

The  Hankel  array  3f,  ,  for  this  sequence  is 

44 


K 


44 


1 

1 

4 

3 

10 

7 

22 

15 

0 

0 

0 

0 

1 

1 

3 

3 

4 

3 

10 

7 

22 

15 

A 

A 

0 

0 

1 

1 

3 

3 

A 

A 

10 

7 

22 

15 

■k 

A 

A 

A 

1 

1 

3 

3 

■k 

A 

A 

A 

22 

15 

* 

* 

A 

A 

A 

A 

3 

3 

A 

A 

A 

A 

A 

A 

The  minimal  partial  realization  (obtained  using  Algorithm  (2.78))  is 
not  unique,  and  has  dimension  p   =  5,  with  controllability  indices 
^'^IM  ^2M'^  ~  {3,2}.   It  is  represented  in  its  most  general  form  by  the 
triple 
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0 

1 

0 
0 
0 


0 

0 

1 

0 
0 


1 1 


-Y 


112 


)  1  i 


121 


-Y 


122 


0 
0 
0 
0 
1 


-^2 
-Y 


212 


-Y. 


21  i 


-Y 


-Y 


221 


222 


1 

0 

0 

0 

0 

0 

0 

1 

0 

0 

D  = 


1    4    10    1    3 
0    0     10    0 
with  Yj^2'  ^121'  ^122'  ^"'^  ''^222  <^°i"Plstely  arbitrary,  and 


Y 


111 


'^'^112   ^121    -^"^122 


113 


-'in   =  -  2 


"^212     ^222 


'213 

Y221  =  5  +  Y222 


It  can  be  shown  that  the  coefficients  of  the  characteristic  polynomial 
of  A  satisfy  the  relation 

62  +  333  +  73^  +  1563  =  -  31 

and  3,  is  completely  arbitrary,  for  any  choice  of  the  arbitrary  y 

ijk 

parameters  of  the  realization.   Since  at  least  one  of  the  (3  }  must 
alway  be  negative,  it  follows  that  all  minimal  partial  realizations 
are  unstable.   The  best  that  one  can  do  is  to  fix  four  stable  poles, 
but  the  fifth  one  is  always  unstable. 

This  example  has  been  solved  by  Tether  (1970)  and  by  Ackerman 
(1972)  using  their  respective  realization  algorithms.   The  realization 
obtained  by  Ackermann  (1972)  is  represented  in  its  most  general  form 
by  the  triple 
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A  = 


I 


0 

1 

0 

0 

0 

-2 

3 

0 

0 

0 

0 

0 

0 

1 

0 

0 

0 

0 

0 

1 

a 

0 

b 

c 

3-a_ 

Q  = 


1 
3 
0 


i      J 


D  = 


1    0    0    0    o" 

0    0    1    0    0 
where  a,  b,  and  c  are  arbitrary.   This  realization  has  only  three  arbi- 
trary poles;  the  regaining  two  are  always  unstable.   The  realization 
obtained  by  Tether  (1970)  is  represented  in  its  .ost  general  for.  by 
the  triple 


A  = 


4 

-1 

0 

0 

0 

1 

1 

6 

-1 

0 

0 

0 

0 

1 

1 

0 

-1 

1 

0 

Q  = 

0 

0 

0 

1 

d-13 

4 

-6d+e+27 

0 

0 

0 

0 

1 

0 

0 

_0 

o_ 

D  = 


1    0    0    0    0~ 
_0    0    0    0    1 
where  d  and  e  are  arbitrary.   This  realization  has  only  two  arbitrary 
poles,  and  the  remaining  three  poles  are  always  unstable.   Both  of  these 
realizations  are  contained  in  the  one  given  previously  (obtained  via  Al- 
gorithm  (2.78)), 

Since  the  minimal  realizations  are  all  unqj-phl^   o       ■     ■      . 

<int  dXL   unstable,  a  non-minimal  stable 

realization  .ust  be  constructed.   For  any  p  ,  e,  the  necessary  condition 
(3.3IW  is  satisfied  trivially  because  N.  -  ,.      The  set  M(p)  contains 
only  t„„  elements:  (4.2)  and  {3.3).   Only  one  stable  realization  is  de- 
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siri'il,    si)    it     is    wdrlliwlii  1 1'    to    invrsl  i  )^',at.c-    wliiih    ol     tlu'sr    i  wo    .si>ts    i :; 

llliM'C     ll'll  Vl'll  itMil   . 

LLsiii^  (2.80),  the  number  of  arbitrary  parameters  is  fouml  te  lie 
e(]ual  to  seven  with  the  set  {4,2},  and  eight  with  the  set  {3,3  K   The 
dimension  of  the  realization  is  six,  so  there  seems  to  be  a  good  chance 
of  obtaining  a  stable  (possibly  arbitrary)  realization  with  each  of 
these  two  sets  of  admissible  controllability  indices.   Even  though  it 
yields  one  less  arbitrary  parameter,  it  is  preferable  to  select  the 
set  {4,2}  because  the  position  that  the  arbitrary  parameters  occupy  in 
A  is  more  ameanable  for  the  analytical  verification  of  stability.   This 
concept  is  expanded  on  below. 

For  the  set  {4,2},  j_     is  arbitrary  because  u   =  No.   Then  the  poles 
of  the  first  subsystem  (the  eigenvalues  of  A..;  see  Theorem  (2.54)  and 
the  comments  which  follow  it)  are  completely  arbitrary.   Notice  that 
p«  =  \iy^,   and  Uiw  >  Vow  imply  ^  is  the  same  as  for  the  minimal  realiza- 
tion.  Thus,  the  poles  of  the  second  subsystem  (the  eigenvalues  of  A^„) 
are  given  by  the  roots  of  the  polynomial 

Y22(s)  =  s'  +  Y222^  +  5  +  y^^^ 
and  choosing  Yoot  ^  ^   guarantees  stability  for  the  second  subsystem. 
Finally,  since  the  two  non-zero  elements  of  A   are  arbitrary,  an  attrac- 
tive and  simple  solution  is  to  let  Yioi  ^  Y199  "^  '^'  select  Yoo-)  ^  0»  and 
choose  the  remaining  arbitrary  parameters  such  that  the  polynomial 

^11^^^  =  ^'  -^  Yii^s^  +  Yii3^'  -^^112^  +  ^111 
matches  any  desired  stable  polynomial.   It  can  be  shown  that  when  the 

subsystems  are  not  forced  to  be  decoupled,  the  realization  of  input 

structure  {4,2}  has  arbitrary  poles. 
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It  can  also  be  verified  that  the  set  {3,3}  gives  an  arbitrary  reali- 
zation, hut  the  simple  decoupled  structure  can  never  he  made  sLahli-. 
[■'or  these  reasons,  the  input  structure  {4,2)  will  be  used. 

The  minimal  stable  realization  of  dimension  6  and  controllability 
indices  {4,2}  is  represented  in  its  most  general  form  by  the  triple 


A  = 


0    0    0    -Y 


-Y 


L 


D  = 


1 

0 

0 

0 

1 

0 

0 

0 

1 

0 

0 

0 

0 

0 

0 

1 

4 

1 

0 

0 

-Y 


111 


112 


113 


-Y 


-Y 


-Y 


114 


121 


122 


0 
0 
0 
0 
0 
1 


-Y 


211 


'212 


-Y 


213 


-Y 


221 


-Y 


222 


Q  = 


L 


1 

o" 

0 

0 

0 

0 

0 

0 

0 

1 

0 

0 

— 

with  Y 


111' 


10    22    1    3 
1     3    0    0 


,  Y,22>  ^"'^  ^222  *^°™Pl^tely  arbitrary,  and 


Y 


211 


-  2 


^213  =  -  ' 


"^212    ^222 


"^221   ^  "''  ^222 

A  stable  realization  with  poles  at  -1,  -1,  -1,  -2,  -1  ±  J2.45 
(approximately)  is  obtained  for  the  following  values  of  the  arbitrary 
parameters 


^111  =  2 
^112  =  ' 
^113=  ' 


^114  =  ' 

^121  "  ^122  "  ° 

Y     =2 
'222 


This  realization  is  both  completely  controllable  and  observable. 

A  minimal  partial  arbitrary  realization  algorithm  is  given  next. 
The  algorithm  follows  closely  the  pattern  of  Algorithm  (3.42),  but  the 
stronger  results  that  are  available  for  the  arbitrary  realization  case 
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ofLi-n  lead  to  an  easier  solution  in  the  form  of  less  iterations.   Kefore 
proceeding  to  state  the  algorithm,  it  is  convenient  to  introduce  t  lie 
following  definition. 

(3.44)   Definition.   The  subset  of  M(p)  that  contains  all  the  sets  {y.} 

for  which  condition  (3.19b)  is  satisfied  is  de- 
noted by  U(p).   That  is, 

U(p)  =  {{]J^}    :  {y.}  e  M(p)  and  p^  +  y  + 
...  +  P^  <  a  -  p(M^)  -  p(M2)  - 

...  -  P(M  )} 
r 

In  words,  Ll(p)    is  made  up  of  all  the  admissible  sets  of  controlla- 
bility indices  that  yield  p  or  more  arbitrary   Y..,   realization  parame- 
ters.   In  the  arbitrary  realization  context  it  is  useless  to  consider 
sets  of  controllability  indices  not  included  in  U(p).   Notice  that  the 
set  U(p)  need  not  be  a  proper  subset  of  M(p) ;  that  is,  often  U(p)  =  M(p) 
(as  in  Example  (3.43)).   The  algorithm  follows. 
(3.45)   Minimal  Partial  Arbitrary  Realization  Algorithm. 

Ste^_k  Use  Algorithm  (2.78)  to  compute  all  minimal  partial  realizations 
of  the  given  sequence.   If  unique,  proceed  to  the  next  step. 
Otherwise,  check  whether  (3.19b)  is  satisfied  with  p  =  p   and 
the  minimal  controllability  indices;  if  so,  check  (by  any  con- 
venient means)  whether  the  minimal  partial  realization  is  ar- 
bitrary or  not.   If  the  minimal  realization  has  arbitrary  poles, 
the  minimal  partial  arbitrary  realization  problem  is  solved  and 
there  is  no  need  to  proceed  any  further.   Otherwise,  proceed  to 
the  next  step, 

Ste^,  Find  the  smallest  value  of  p  >  p^^  +  i  and  the  corresponding  set 
U(p)  for  which  condition  (3.19b)  is  satisfied. 
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^t-op  3.   Use  Algorithm  (3.36)  with  U(p)  instead  of  M(p)  to  obtain  all 

inirtial  realizations  of  dimension  p  that  are  possibli^  randidales 
for  minimal  partial  arbitrary  realizations. 
Stej)_'^   ff  partial  realizations  of  dimension  p  do  not  exist,  increase 
p  by  one,  form  the  set  U(p),  and  repeat  Step  3.   Otherwise, 
proceed  to  check  (by  any  convenient  means)  in  a  systematic 
manner  whether  the  completely  controllable  and  observable  reali- 
zations of  dimension  p  have  arbitrary  poles.   If  any  of  these 
realizations  has  completely  arbitrary  poles,  the  procedure  is 
finished.   Otherwise,  increase  p  by  one,  form  the  set  U(p),  and 
repeat  Step  3. 
Proof.   The  proof  is  obvious.  V 

The  algorithms  presented  in  this  section  are  most  useful  when  none 
of  the  conditions  mentioned  in  Remark  (3.34)  occur.   Whenever  any  one 
of  these  conditions  occurs,  it  is  simpler  to  use  the  construction  out- 
lined in  the  proof  of  Theorem  (3.22),  or  a  modified  version  of  Algo- 
rithm (3.36).   The  modifications  to  be  done  to  Algorithm  (3.36)  depend 
on  the  specific  problem  at  hand,  but  it  is  not  (generally)  difficult  to 
recognize  what  should  be  modified,  as  is  the  case  in  the  following  ex- 
amples. 

(3.46)   Example.   It  is  desired  to  obtain  the  minimal  partial  arbitrary 
realization  of  the  following  (row)  vector  sequence 

?!  =  [1    0    1]    ?2  =  f°    1    0]   £3  =  tl    1    -1] 

C4  =  [0    0    0] 
From  Corollary  (3.18),  the  dimension  of  the  minimal  partial  arbitrary 
realization  is  four,  and  the  realization  can  be  immediately  constructed 
by  inspection  as  the  dual  of  (3. 12)-(3. 14) .   It  is  given  by  the  triple 
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A  = 


-  6 


i2 


^3 


h 


Q  = 


il 


h 


J         .T 


T 
with  B   =  [6^    B2    63    6^]  a  completely  arbitrary  vector.  V 

(3.47)   Example.   It  is  desired  to  obtain  the  minimal  partial  arbitrary 
realization  of  the  following  matrix  sequence 


1 

-1 

0 


-1 

1 
0 


2 

-2 

0 


0 
0 
0 


The  corresponding  Hankel  array  7f   is 


3C. 
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* 
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1 

1 

* 

* 

* 

A 

Almost  immediately  it  is  recognized  that  p^,  =  rNo  =  6  and  u   =  n    =3 

M  ^IM   ^2M 

Then,  from  Theorem  (3.22)  it  follows  that  the  minimal  partial  realiza- 
tion has  completely  arbitrary  poles  (p^  =  p^  =  p^)  and  can  be  obtained 
by  inspection.   It  is  given  by  the  triple 


A  =    U2        13 


-^i       ^5       h 


-I2J  Q  =    [i^        i^] 


where 


"  ■  '^n     ^12     in     I21     ^22     123) 
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^1  =  f^Ul   ^112   "^113   ^121   ^122   ^123^ 
^2  =  ^^211   Y212   Y213   ^221   ^222   ^223^ 
are  completely  arbitrary  vectors.  n 

It  is  evident  in  Example  (3.46)  that  the  observability  index,  6, 
and  the  vectors  U.)  are  invariants  of  the  minimal  partial  arbitrary 
realization  of  the  given  (row)  vector  sequence.   Notice  also  that  the 
controllability  indices  {y.}  and  the  vectors  {l.^}   are  invariants  of 
the  minimal  partial,  the  minimal  partial  stable,  and  the  minimal  par- 
tial arbitrary  realization  of  the  matrix  sequence  of  Example  (3.47). 
If  the  partial  realization  with  controllability  indices  {3,3}  is  con- 
structed for  the  matrix  sequence  of  Example  (3.43),  it  is  found  that 
the  vectors  £^^,  Z^^,    i^^,    Z^^^    and  £^2  ^^^   minimal  partial  stable  and 

minimal  partial  arbitrary  realization  invariants,  while  the  vectors  Z 

—14 

and  ^23  and  the  controllability  indices  are  not.   From  these  observations 

and  the  results  of  Chapter  2  on  minimal  partial  realizations,  it  is 

apparent  that  whether  or  not  the  parameters  {r  }  and  (y    }  and  the  vec- 

1        ijk 

tors  {Z^^}   are  minimal  partial,  minimal  partial  stable  and/or  minimal 
partial  arbitrary  realization  invariants  is  dependent  exclusively  upon 
the  given  matrix  sequence.   These  concepts  are  made  more  precise  in  the 
following  remark. 

(3.48)   Remark.   Recall  that  a  complete  system  of  invariants  (for  the 
equivalence  relation  defined  by  a  change  of  basis  on  the  state  space) 
for  an  infinite  matrix  sequence  that  admits  a  finite-dimensional  reali- 
zation consists  of  the  parameters  {y. }  and  {y. .,  }  and  the  vectors  {£   ). 

1        ij  k  '—^  k 

It  would  be  very  convenient  if  analogous  results  could  be  stated  for  a 
finite  matrix  sequence  and  its  corresponding  minimal  partial,  minimal 
partial  stable,  and  minimal  partial  arbitrary  realizations,  but  this 
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does  not  seem  to  be  the  case.   Nevertheless,  some  Invariants  (for  more 

general  equivalence  relations)  can  be  identified  for  these  problems. 

Let  S  (p  )  be  the  set  of  all  completely  controllable  and  observable 

matrix  triples  (A,Q,D)    that  satisfy  condition  (2.5a)  for  a  given  ma- 

trix  sequence  of  No  elements,  S  (p  )  be  the  set  of  all  completely  con- 

trollable  and  observable  matrix  triples  (A,Q,D)    that  satisfy  conditions 

(3.1a)  and  (3.1c)  for  a  given  matrix  sequence  of  No  elements,  and  S  (p  ) 

be  the  set  of  all  completely  controllable  and  observable  matrix  triples 

(A,Q,D)    that  satisfy  conditions  (3.2a)  and  (3.2c)  for  a  given  matrix 

A 
sequence  of  No  elements.   Then  the  following  statements  can  be  made. 

a)  The  parameters  {y.„},  the  vectors  {I.,  },    and  those 

parameters  (y..,  }  that  have  fixed  numerical  values 
ijk 

are  invariants  for  an  appropriately-defined  equiva- 
lence relation  on  S„(p„).   These  invariants  form  a 

M  M 

complete  system  of  invariants  for  the  equivalence 

relation  defined  by  GL(p)  acting  on  5„(p^J  if  and 

M  M 

only  if  the  minimal  partial  realization  of  the  se- 
quence is  unique  (in  other  words,  when  all  the  {y .  .,} 
parameters  have  fixed  numerical  values). 

b)  The  vectors  U.,}  for  j  =  1,2,. ..,r  and  k  =  1,2,..., 
y   only,  and  those  parameters  {y...  }  that  have  fixed 
numerical  values  are  invariants  for  an  appropriately- 
defined  equivalence  relation  on  S^(p„)  when  p„  >  p,,. 

S   S        S    M 

In  some  cases  it  is  possible  that  one  or  more  parame- 
ters {y.}  and  vectors  {£.,  }  for  some  1  <  i  <  r  and 
k  =  y   ,y.   j,...,y.  are  also  Invariants.   These  in- 
variants form  a  complete  system  of  invariants  for  the 
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equivalence  relation  defined  by  GL(p)  acting  on 
•^M^Pm^  if  and  only  if  p^  =  p^(which  implies  S  (p  )  = 
\^Pm^^  a"d  the  minimal  partial  realization  is  unique. 
c)   The  vectors  U.^]    for  j  =  l,2,...,r  and  k  =  1,2,..., 
^jM  °'^-'-^'  ^"^  those  parameters  (y.-j^)  that  have  fixed 
numerical  values  are  invariants  for  an  appropriately- 
defined  equivalence  relation  on  S.(pJ  when  p   >  n 

A  ^A       ^A   '■^M' 

In  some  cases  it  is  possible  that  one  or  more  parame- 
ters {y  }  and  vectors  {£.,  }  for  some  1  <  i  <  r  and 

~  '^iM'^iM+l '  ■  *  ■ '^i  ^^^  also  invariants. 
The  form  of  the  equivalence  relation  that  applies  in  the  above 
statements  is  probably  not  easily  specified,  in  general.   More  research 
in  this  area  is  needed.  y 

The  realization  theory  results  presented  thus  far  have  a  signifi- 
cant application  in  the  design  of  minimal  order  observers  discussed  in 
the  following  chapter.   As  a  matter  of  fact,  it  was  the  observer  design 
problem  which  promoted  the  formulation  and  present  discussion  of  the 
minimal  partial  stable  and  the  minimal  partial  arbitrary  realization  pro- 
blems.  As  mentioned  above,  the  treatment  given  here  to  these  problems 
is  by  no  means  final.   Several  interesting  questions  remain  open,  and  it 
is  likely  that  even  more  questions  will  be  uncovered  in  the  future.   It 
also  seems  that  the  realization  theory  results  of  these  two  chapters 
(2  and  3)  will  find  application  in  other  hitherto  unrelated  areas  (be- 
sides observer  design).   These  comments  are  expanded  in  Chapter  5. 

A  discussion  of  the  numerical  aspect  of  the  solution  to  these  pro- 
blems is  not  within  the  scope  of  this  work,  although  the  practical  im- 
portance of  such  considerations  is  recognized.   Observe  that  there  are 
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no  conceptual  difficulties  involved  in  the  application  of  algorithms 
(3.36),  (3.42),  and  (3.45).  However,  it  is  not  a  simple  task  to  verify 
observability  for  a  triple  in  the  form  (2. 55)-(2. 57) ,  and  to  check 
whether  matrix  A  has  stable  or  arbitrary  poles  when  several  of  the  ele- 
ments of  the  pair  (A,D)  are  unspecified  or  are  expressed  as  a  function 
(possibly  nonlinear)  of  other  unspecified  elements.  Success  or  failure 
in  solving  such  problems  depends  on  the  experience  and  ingenuity  of  the 
person  solving  the  problem,  and  on  the  numerical  technique  used. 


CHAPTER  4 
DESIGN  OF  OBSERVERS  VIA  REALIZATION  THEORY 

In  this  chapter  the  design  of  low  order  observers  to  estimate  vec- 
tor linear  functions  of  the  state  of  a  multivariable  linear  system  is 
discussed.   The  problem  is  defined  formally  and  a  solution  is  proposed 
from  a  completely  new  point  of  view.   Three  special  problems  are  con- 
sidered in  detail:   the  design  of  minimal  order  (stable)  observers,  the 
design  of  minimal  order  observers  with  arbitrary  poles,  and  the  design 
of  intermediate  order  observers.    It  is  shown  that  the  structure  and 
dynamics  of  these  observers  depend  exclusively  on  the  output  structure 
of  the  observed  system  and  on  the  given  feedback  control  law.   The  de- 
sign procedure  presented  here  gives  all  the  possible  observers  of  spe- 
cified dimension  for  a  given  system  and  control  law,  and  the  observer 
system  matrix  is  obtained  in  the  form  (2.55). 

Loosely  speaking,  an  observer  is  a  system  which  processes  (on-line) 
the  information  available  in  a  system's  inputs  and  outputs  to  provide 
an  asymptotic  approximation  (in  the  sense  that  the  error  goes  to  zero 
as  time  increases)  of  a  vector  linear  function  of  the  given  system's 
state.   This  makes  observers  be  of  significant  importance  because  the 
solution  to  most  modern  control  algorithms  (for  example,  linear  quadratic 
loss,  pole  placement,  decoupling,  etc.)  is  generally  expressed  as  a 
linear  feedback  function  of  the  state,  and  only  seldom  is  the  complete 
state  available  for  feedback.   In  the  cases  that  the  complete  state  is 
not  available,  the  output  of  an  observer  together  with  the  observed 
system  output  can  be  used  as  a  sufficiently  accurate  replacement.   The 
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dimension  of  an  observer  which  estimates  the  complete  state  is  equal 
to  (or  larger  than)  the  number  of  system  states  minus  the  number  of  its 
linearly  independent  outputs,  and  the  poles  of  the  observer  can  be 
chosen  practically  at  will  (the  only  requirement  is  that  of  stability, 
although  certain  other  considerations  may  be  important;  see  Bongiorno 
and  Youla,  1968,  1970,  and  Bongiorno,  1973).   If  the  feedback  control 
function  to  be  implemented  is  known  precisely  and  beforehand,  it  is 
usually  possible  to  design  an  observer  of  smaller  dimension  at  the  ex- 
pense of  some  loss  in  arbitrariness  of  the  observer  pole  positions.  In 
most  cases,  the  reduction  in  the  order  of  the  observer  more  than  justi- 
fies the  loss  in  arbitrariness  of  its  pole  positions. 

The  observer  design  problem  was  formulated  and  solved  first  in  1964 
by  Luenberger  (1964),  who  proposed  a  design  procedure  for  single  output 
systems  only.   Two  years  later,  Luenberger  (1966)  extended  his  original 
results  to  systems  with  several  outputs,  and  considered  the  problem  of 
observing  a  scalar  linear  function  of  the  state.   Since  then,  a  signi- 
ficant number  of  new  results  and  extensions  have  been  discussed  in  the 
literature  (see  Luenberger,  1971,  for  a  state-of-the-art  tutorial  and 
survey  of  results;  see  also  Chapter  1  of  this  work  for  a  discussion  of 
post-1971  developments).   As  of  today,  the  problem  of  designing  minimal 
order  observers  to  estimate  the  complete  state  has  received  most  of  the 
attention,  and  there  are  several  techniques  available  to  carry  out  this 
design.   Some  of  the  most  significant  ones  are  those  of  Bongiorno  and 
Youla  (1968),  Johnson  (1969),  Retallack  (1970),  Gopinath  (1971),  Jameson 
and  Rothschild  (1971),  and  Wolovich  (1973a).  Results  in  the  design  of 
minimal  (or  reduced)  order  observers  to  estimate  vector  linear  functions 
of  the  state  have  not  been  so  prolific.   Most  of  the  results  for  this 
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problem  have  been  obtained  very  recently  (1970-197A),  and  are,  at  best, 
only  partial.   The  most  relevant  work  for  this  specific  problem  has  been 
done  by  Haley  (1967),  Williamson  (1970),  Rothschild  and  Grammaticos 
(1971),  Fortmann  and  Williamson  (1972),  Wang  and  Davison  (1973)  and 
Roman  and  Bullock  (1974). 

The  contributions  of  this  chapter  to  observer  theory  are  manifold. 
It  is  shown  that  the  solution  to  an  observer  design  problem  can  be  ob- 
tained (in  all  cases)  via  the  solution  of  an  appropriately  formulated 
partial  realization  problem.   This  close  relationship  between  observer 
theory  and  realization  theory  is  reported  here  for  the  first  time.   A 
solution  is  given  for  the  special  cases  where  a  vector  linear  function 
of  the  state  is  to  be  estimated  with  an  observer  of:   a)  minimal  order 
and  stable  poles,  b)  minimal  order  and  arbitrary  poles,  and  c)  specified 
intermediate  dimension  and  stable  poles.   These  problems  have  been  dis- 
cussed to  some  extent  in  the  literature  (see  the  references  cited  in 
the  preceding  paragraph) ,  but  the  currently  available  results  are  far 
from  complete.   The  discussion  given  here  is  thorough,  and  the  proposed 
design  procedures  can  always  be  used  to  obtain  the  desired  answer  in 
all  three  of  these  cases.   Finally,  several  of  the  previous  observer 
diesign  techniques  are  examined  in  the  realization  theory  context,  and 
it  is  shown  that  each  corresponds  to  a  specific  type  of  partial  reali- 
zation algorithm.   Thus,  the  realization  theory  setting  can  be  used  as 
a  means  for  comparing  and  evaluating  different  observer  design  techni- 
ques. 

Problem  Statement 

In  this  section  the  observer  design  problem  is  formulated  and  the 
basic  results  in  observer  theory  are  presented.   These  results  are  not 
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proved  or  discussed  extensively,  since  they  are  well  known  and  readily 
available  in  the  literature. 

The  systems  considered  are  defined  by  equations  of  the  form  (with- 
out  loss  of  generality) 


(4.1a) 


X  =  Fx  +  Gu  = 


11      12 
F„,     F, 


X  + 


u 


(4.1b) 


"21    ^22 
^  =  "^  =  f°r,n-r    ^r^^ 
where  x  is  the  n-dimensional  state  vector,  u  is  the  m-dimensional  input 
vector,  i  is  the  r-dimensional  output  vector,  and  F,  G,  H  are  matrices 
of  appropriate  dimensions  with  partitions  defined  as  follows:  F  ^  is 
(n-r)x(n-r),  F^^  is  (n-r)xr,  F^^  is  rx(n-r),  F^^  is  rxr,  G^  is  (n-r)xm. 
and  G^  is  rxm.   It  is  assumed  that  (4.1)  represents  a  completely  obser- 
vable system,  and  that  r  <  n.   System  (4.1)  will  also  be  denoted  by  the 
triple  (F.G,H)^,  and  occasionally  referred  to  as  the  plant. 

Suppose  now  that  a  feedback  control  law  of  the  form 
(^■2)  u  =  Kx  =  [K^    K^lx 

where  K  is  an  mxn  matrix,  K^  is  mx(n-r),  and  K^  is  mxr,  is  specified  for 

implementation.   More  Dreci«;plv   m^  f^ii 

iore  precisely,  the  following  problem  is  to  be  solved. 

(4.3)   Definition.   Given  a  completely  observable  plant  of  the  form 

(4.1)  and  a  feedback  control  law  of  the  form  (4.2), 
find  a  method  to  implement  the  given  control  law  so 
that  the  overall  closed  loop  system  behaves  as  if 
complete  state  variable  feedback  is  used: 
X  =  [F  +  GK]x  +  Gv 
Z  =  Hx 
where  v  is  an  m-dimensional  external  input. 


(4.4a) 
(4.4b) 
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This  problem  (expressed  in  a  different  form)  is  probably  the  oldest 
problem  in  control  theory.   It  corresponds  to  the  classical  compensator 
transfer  function  design  problem,  and  has  been  treated  extensively  in 
the  classical  control  literature  for  single  input/output  systems  (see, 
for  example,  D'Azzo  and  Houpis,  1966;  Saucedo  and  Schiring,  1968).   The 
classical  control  methods  (Root  locus,  Bode  plots,  Nyquist  and  Nichols 
diagram,  etc.)  are  adequate  for  single  input/output  systems,  but  become 
close  to  impossible  to  work  with  for  multivariable  systems.   This  is 
due  to  the  fact  that  most  classical  techniques  are  analysis  tools  rather 
than  design  tools. 

The  advent  of  state  variable  methods  in  the  late  '50s  and  early 
'60t  shed  new  light  into  the  solution  of  problem  (4.3)  and  similar  prob- 
lems because  it  became  possible  to  formulate  these  questions  in  a  more 
precise  and  mathematical  manner,  and  consequently,  a  wealth  of  results 
in  several  mathematical  fields  (linear  algebra,  calculus  of  variations, 
functional  analysis,  etc.)  were  readily  adopted. 

In  the  context  of  modern  control  theory,  several  solutions  have 
been  proposed  for  problem  (4.3).   Notably  are  those  of  Pearson  (1969), 
Pearson  and  Ding  (1969),  Ferguson  and  Rekasius  (1969),  Brasch  and 
Pearson  (1970),  Chen  (1970),  and  Morse  and  Wonham  (1970).   However,  none 
of  these  solutions  seem  to  enjoy  the  advantages  of  the  so-called  ob- 
servers (the  treatment  of  initial  conditions ,  the  straightforward  assign- 
ment of  the  observer  poles,  and  other  significant  properties).  Moore 
(1970)  gives  an  interesting  comparison  of  observers  and  several  alter- 
nate compensator  design  techniques.   The  material  discussed  in  this 
work  is  limited  to  observers  only.  The  results  given  in  the  first  three 
sections  of  this  chapter  are  the  subject  of  a  forthcoming  paper  (Roman 
and  Bullock,  1975). 
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Consider  a  system  of  the  form 

(^•5a)         z^  =  Az  +  Bu  +  C^ 

('^•5b)         w  =  Dz  +  E^ 

where  z  is  the  p-dimensional  state  vector,  „  is  the  m-dimensional  output 
vector,  A,  B,  C,  D,  E  are  matrices  of  appropriate  dimensions,  and  u, 
Z   are  as  previously  defined.   System  (4.5)  is  also  represented  by  the 

quintuple  (A,B,C,D,E)  . 

P 

(4.6)   Definition.   System  (4.5)  is  said  to  be  an  observer  for  the  feed- 
back control  law  (4.2)  of  system  (4.1)  if  the  output 
of  (4.5)  provides  an  asymptotic  estimate  of  Kx  in 
the  sense  that 
^'^•^)  w  =  Kx  +  £ 

where  £.  ->  0  as  t  -^-  oo. 
It  seems  reasonable  to  expect  that  if  (4.7)  is  true,  then  using 
w  instead  of  Kx  yields  a  satisfactory  closed  loop  system,  at  least  in 
the  steady-state.   This  indeed  turns  out  to  be  the  case,  and  satisfac- 
tory results  are  obtained  even  under  transient  conditions  (Luenberger, 
1964;  also  Anderson  and  Moore,  1971).   Notice  that  it  is  pointless  to 
design  an  uncontrollable  and/or  unobservable  observer,  because  the  cor- 
responding reduced  order  system  (after  removing  uncontrollable  and/or 
unobservable  states)  provides  the  same  estimate  of  Kx. 

The  following  theorem  contains  the  fundamental  results  of  observer 
theory.   The  proof  is  omitted  since  it  is  available  (in  parts)  in  the 

literature  (see  Luenberger,  1964,  1966,  1971,  or  Fortmann  and  Williamson, 
1972). 

(4.8)   Theorem.   System  (4.5)  is  an  observer  for  the  feedback  control 

law  (4.2)  of  system  (4.1)  if  and  only  if  (F,H)   is  a 

n 


(4.9) 
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completely  observable  pair  and  the  following  condi- 
tions are  satisfied: 

a)  B  =  TG 

b)  CH  =  TF  -  AT 

c)  K  =  DT  +  EH 

d)  all  the  eigenvalues  of  A  have  negative  real 
parts 

where  T  is  a  pxn  matrix  that  relates  the  state  of  (4.1) 

to  the  state  of  (4.5)  as  follows 

At 
z  =  Tx  +  e''^[z(0)  -  Tx(0)]  =  Tx  +  e 


_z(0)  and  x(0)  are  the  initial  conditions   on  (4.5)  and 
(4.  1)  ,  respectively,  and  G  ^  0  as  t  ^  oo  (in  view  of 
(4.8d)).   Also,  e^   =   Be.      Further,  T  is  unique  if  and 
only  if  A  and  F  have  no  eigenvalues  in  common,  and  the 
n  +  p  poles  of  the  closed  loop  system  obtained  using 
u  =  w  in  (4.1)  and  (4.5)  are  given  by  the  eigenvalues 
of  F  +  GK  and  A. 
Theorem  (4.8)  also  includes  the  case  where  the  complete  state 
(rather  than  Kx)  must  be  estimated.   This  special  case  is  considered  by 
replacing  K  in  (4.8c)  with  the  n-dimensional  identity  matrix.   In  this 
sense,  the  above  theorem  is  completely  general. 

The  following  remark  is  important. 
(4.10)   Remark.  Observe  that  conditions  (4. 8a)-(4. 8c)  are  purely  alge- 
braic; the  solution  of  these  equations  for  the  quintuple  (A,B,C,D,E) 

P 
and  matrix  T  requires  mathematical  knowledge  but  very  little  "guesswork". 

Notice  also  that  (4.8a)  is  very  easily  handled  once  matrices  A,  C,  D,  E, 
and  T  are  found  which  satisfy  (4. 8b)- (4. 8d) .  For  this  reason,  condition 
(4.8a)  can  be  set  aside  until  T  is  available.  V 
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Theorem  (4,8)  states  the  (necessary  and  sufficient)  conditions  that 
must  be  satisfied  by  a  system  of  dimension  p  to  be  an  observer  for  Kx- 
That  is,  given  a  (completely  observable)  system  (4.1),  a  feedback  con- 
trol law  (4.2),  and  a  system  (4.5),  then  using  conditions  (4.8a)-(4. 8d) 
one  can  determine  whether  or  not  (4.5)  is  an  observer  for  the  feedback 
control  law  (4.2)  of  system  (4.1).   But  there  are  still  other  questions 
of  interest.    Several  different  problems  can  be  posed  by  placing  re- 
strictions on  the  value  of  p,  or  on  the  allowable  observer  poles,  speci- 
fying a  desired  observer  characteristic,  or  combinations  of  these.  The 
following  two  definitions  state  the  most  significant  specific  problems 
that  are  discussed  in  this  work. 

(4.11)  Definition-.   System  (4.5)  is  a  minimal  order  observer  for  the 

feedback  control  law  (4.2)  of  system  (4.1)  if  the 
conditions  (4. 8a)-(4. 8d)  are  satisified,  and  p  is 
as  small  as  possible. 

(4.12)  Definition.   System  (4.5)  is  a  minimal  order  arbitrary  observer 

for  the  feedback  control  law  (4.2)  of  system  (4.1) 
if  the  conditions  (4.8a)-(4.8d)  are  satisfied,  the 
eigenvalues  of  A  can  assume  any  set  of  p  (stable) 
values,  and  p  is  as  small  as  possible. 
It  is  shown  in  the  sequel  that  the  solution  to  these  and  other 
similar  problems  can  always  be  obtained  through  the  solution  to  related 
minimal  partial  realization  problems,  and  that  the  value  of  p  depends  on 
Kp  the  output  structure  of  (4.1),  and  the  desired  observer  characteris- 
tics.  In  order  to  do  so,  it  convenient  to  introduce  a  specific  set  of 
coordinates  for  the  state-space  of  (4.1)  and  carry  out  some  simplifica- 
tions on  (4,8a)- (4.8c) .   This  is  done  in  the  next  section. 
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Preliminary  Results 

The  constraints  (4. 8a)-(4. 8d)  that  must  be  satisfied  by  a  quintuple 

(A,B,C,D,E)   which  defines  an  observer  for  Kx  are  not  as  formidable  as 
P  - 

they  appear  at  first  glance.   If  p  is  chosen  sufficiently  large 
(p  ^  n  -  r) ,  then  it  is  not  too  difficult  to  solve  for  the  observer 
matrices  (see,  for  example,  Gopinath,  1971;  or  Luenberger,  1971).   Ob- 
servers of  dimension  equal  to  n  -  r  are  commonly  referred  to  as  full- 
state  observers. 

The  observers  of  interest  here  are  minimal  order  observers,  minimal 
order  arbitrary  observers,  and  intermediate  order  observers  (of  dimen- 
sion larger  than  minimal  but  smaller  than  n  -  r) .   Therefore,  the  objec- 
tive is  to  solve  (4.8b)  and  (4.8c)  subject  to  A  having  stable  or  arbi- 
trary eigenvalues  and  p  being  minimal  or  equal  to  a  specified  value 
(recall  that  (4.8a)  does  not  place  any  restrictions  on  T  and  consequently, 
is  easily  handled  once  T  is  obtained).   It  is  shown  below  that  conditions 
(4.8b)  and  (4.8c)  reduce  to  a  single  condition   involving  only  A,  D,-  K  , 
and  a  submatrix  of  T  (defined  below).   This  result  is  arrived  at  through 
the  selection  of  special  coordinates  for  system  (4.1),  But  first  it  is 
convenient  to  carry  out  some  manipulations  on  (4.8b)  and  (4.8c). 

Define  a  partition  on  T  as  follows 

(4.13)  T  =  [T^    T^] 

where  T  is  px(n-r)  and  T  is  pxr.   Now  substitute  the  partitioned  ma- 
trices F,  H,  K,  and  T  into  (4.8b)  and  (4.8c)  to  obtain 

(4.14)  C  =  T^F^2  +  V22  -  ^^2 

(4.15)  E  =  K2  -  DT2 

(4.16)  T^F^^   =  AT^  -  T^F^^ 

(4.17)  K  =  DT 
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These  equations  represent  a  simpler  set  of  equations  than  (4.8b)  and 
(4.8c)  in  the  following  sense.   Observe  that  C  and  E  are  defined  expli- 
citly in  terms  of  the  other  matrices.   Thus,  once  matrices  A,  D,  and  T 
are  found  which  satisfy  (4.16),  (4.17),  and  the  specified  constraints 
on  the  value  of  p  and  eigenvalues  of  A,  then  C  and  E  are  easily  obtained 
using  (4.14)  and  (4.15),  respectively. 

The  following  simple  but  helpful  lemma  can  be  immediately  derived 
from  (4.17). 

(4.18)  Lemma.   The  dimension  of  an  observer  which  estimates  Kx  for  sys- 

tem (4.1)  is  bounded  below  by  the  rank  of  K, .   That  is, 

(4.19)  p  >  p(K^) 

The  simple  proof  of  Lemma  (4.18)  is  omitted.   Bound  (4.19)  is  not 
too  strong  in  general,  but  is  easy  to  obtain  (it  is  strongest  in  the 
cases  where  m  is  very  close  to  n  -  r).   A  stronger  bound  for  the  dimen- 
sion of  an  observer  for  Kx  is  given  in  Remark  (4.43). 

Conditions  (4.8d),  (4.16),  and  (4.17)  determine  the  allowable  A, 
D,  and  T  matrices  for  the  desired  observer  properties  (minimal  order, 
minimal  order  and  arbitrary  poles,  intermediate  order,  etc.).   Equations 
(4.16)  and  (4.17)  are  nonlinear  equations  in  the  elements  of  the  matrices 
A,  D,  and  T.   Generally,  nonlinear  equations  do  not  lend  themselves  to 
a  straightforward  analytic  solution.   In  the  case  at  hand  the  situtation 
is  more  complex  than  usual  due  to  the  other  requirements  imposed  on  the 
elements  of  A.   Fortunately,  these  particular  equations  can  be  further 
simplified  considerably. 

Notice  that  (4.16)  is  of  the  same  form  as  (4.8b).   This  similarity 
is  very  convenient  because  equations  of  the  form  (4.8b)  have  been  studied 
extensively  in  matrix  theory  by  Gantraacher  (1969,  Vol.  1)  and  Luenberger 
(1965),  and  also  specifically  in  the  observer  co-ntext  by  Luenberger 
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(1964,  1966,  1971),  Bongiorno  and  Youla  (1968),  and  Gopinath  (1971), 
among  others.   So,  it  is  reasonable  to  expect  that  one  or  more  of  the 
available  techniques  can  be  used  to  simplify  equation  (4.16).   This  in- 
deed turns  out  to  be  the  case.   The  discussions  and  results  that  follow 
are  basic  toward  such  a  development. 

(4.20)  Remark.  The  partitions  defined  on  F  and  H  in  (4.1)  implicitly 
define  a  partition  on  x  as  /  =  [x^  X2]  "^ere  x^  is  (n-r)xl  and  x^  is 
rxl.   That  is,  (4.1)  is  equivalent  to 


(^•21a)  x^  =  F^^x^  +F^2^2+  V 
(4.21b)  ^2  =  ^21^1  +  ^22^2  +  S^ 
(4.21c)       Z  =  2£2 


System  (4.1)  is  completely  observable,  so  system  (4.21)  is  completely 
observable;  therefore,  x^  must  be  observed  from  X2-   Intuitively,  the 
pair  (F^^,F2p^_^  must  be  a  completely  observable  pair.   This  is  indeed 
true,  as  stated  in  the  following  lemma  due  to  Gopinath  (1971). 
(4.22)   Lemma.   Consider  a  linear  system  with  partitions  defined  as 

in  (4.1).   If  the  pair  (F,H)   is  completely  observable, 
then  the  pair  (F^^,F2^)^_^  is  also  completely  observable 
The  proof  of  Lemma  (4.22)  consists  of  performing  several  simple 
row  operations  on  the  observability  matrix  of  (4.1).   The  details  are 
omitted  here  for  brevity. 

A  simple  but  important  corollary  is  obtained  as  a  by-product  of 
the  proof  of  Lemma  (4.22).   It  is  given  after  the  following  definition. 
(4.23)   Definition.   The  set  of  observability  indices  of  system  (4.1) 

is  denoted  by  the  set  {v.};  correspondingly, 
V  =  max(v^)  is  the  observability  index  of  (4.1). 
On  occassions,  the  integer  V  -  1  is  denoted  as  No . 


V 
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(4.24)  Corollary.   The  set  of  observability  indices  of  the  matrix  pair 

(F,,,F..)    is  given  by  the  set  {u.  :  u.  =  v.  -  1, 
11'  21  n-r    b  J  XIX 

X  =    1,2,. . . ,r}. 

Corollary  (4.24)  allows  the  application  of  a  well-known  result  to 

the  matrix  pair  (F,,,F_,)    .   This  is  the  following  lemma. 
11  21  n-r 

(4.25)  Lemma.   If  the  matrix  pair  (F   ,F^)  _   is  a  completely  observa- 

ble pair,  then  it  can  be  represented  in  a  specific  basis 
as  follows 


(4.26) 


11 


0 


u^-1 


0^-1 


-0^-1 


-0^-1 


(4.27) 


21 


-u^+u^ 


i^ 

—n-r 


where  f^  is  an  (n-r) -dimensional  vector. 
The  proof  of  this  lemma  is  also  omitted  because  it  does  not  con- 
tribute to  the  present  discussion  and  there  are  several  proofs  available 
in  the  literature  (see  Luenberger,  1967,  or  Roman  et  al. ,  1973,  for  two 
different  proofs). 


123 


(A. 28)   Remark.   In  (4.26)  and  (4.27)  it  has  been  impTiritly  aRsumr.l  that 

u     1  for  i  =  l,2,...,r.   This  assumption  is  introdiued  only  lor  luil.i- 
i 

tional  simplicity,  and  is  used  throughout  the  rest  of  this  dissertation. 
It  is  also  assumed  in  the  sequel  (without  loss  of  generality)  that  the 
pair  (F   ,F   )  _   is  given  in  the  form  (4. 26)-(4. 27) .   K,  G,  F^^'  ^nd 
F   are  also  assumed  to  be  given  in  the  corresponding  coordinates.      V 

(4.29)  Remark.   It  is  important  to  note  that  the  form  given  in  Lemma 
(4.25)  is  different  from  the  form  described  in  Theorem  (2.54).   The  form 
(4.26)-(4. 27)  for  a   matrix  pair  is  not  canonical  (under  the  action  of 
GL(p))  except  in  very  special  cases;  namely,  when  S(p)  is  the  set  of  all 
completely  controllable  matrix  pairs  for  which  u^  =  U^  •  .  •  =  ^^  (see 
Kalman,  1971a).   It  is  interesting  to  note  that  in  the  particular  cases 
when  (4. 26)- (4. 27)  is  canonical,  the  parameters  ^^Q^.j^^  of  the  dual  of 
(2. 55)-(2.56)  and  the  elements  of  the  vectors  {f;. }  are  related  to  each 
other  through  a  set  of  simple  formulas  (see  Munro,  1973,  1974). 

Luo  and  Bullock  (1975)  have  shown  that  some  of  the  elements  of  the 

vectors  {f  }  in  (4.26)  can  be  set  to  zero  once  the  {u.}  are  known,  but 
— i  1 

this  fact  is  not  very  significant  in  the  present  discussion.  V 

With  the  aid  of  Lemma  (4.25),  it  is  possible  to  simplify  (4.16)  con- 
siderably and  obtain  as  a  result  the  columns  of  T^  expressed  in  terms 
of  F  .,  A,  and  r  specific  columns  of  T  ,  and  obtain  also  a  set  of  simple 
recurrence  relations  for  the  columns  of  T  . 

Let  the  columns  of  T  and  T  be  labeled  as  follows 

(4.30)  T^  =  [t^^   t^2   •••  ^lU^   ^21   •••  ^2U2  •••  ^1  •••  ^rvj 

(4.31)  T2  =  [t^   t^        ...    t^] 
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Then  the  following  result  can  be  stated. 

(4.32)  Lemma.   Consider  equation  (4.16)  and  suppose  the  matrix  pair 

(F,,,F^,)     is  given  in  the  form  (4. 16)-(4. 27) .  Then 
ii  ZL   n-r 

the  columns  of  matrices  T  and  T„  satisfy  the  following 
relations 

a)  t. .  =  A^~  t.,  i  =  1,2,. ..  ,r 
-13       -il 

^  j  =  1,2,... ,u^ 

b)  t.  =  A  ^t.,  +  T,f .  .    ,  „ 

—1      —X 1    I— 1  1  =  1 ,  z  , . . .  ,  r 

Proof.   Follows  by  direct  substitution  of  (4.26),  (4.27),  (4.30),  and 
(4.31)  into  (4.16).  \ 

The  relations  given  in  Lenmia  (4.32)  for  the  columns  of  T  and  T 
are  similar  to  those  derived  by  Luenberger  (1966)  for  the  columns  of  T 
and  C,  respectively,  in  the  solution  of  (4.8b)  for  the  design  of  a  full- 
state  observer.   Williamson  (1970)  and  Fortmann  and  Williamson  (1972) 
have  also  used  similar  relations  for  the  design  of  intermediate  order 
observers. 

The  following  notation  is  introduced  to  simplify  future  explana- 
tions and  to  be  able  to  relate  the  results  of  Chapters  2  and  3  to  this 
discussion. 

(4.33)  Notation.   The  vectors  t,,,  t.,  ...,  t  ,  are  also  denoted  by 

—1 1  —2 1      — r  1 

the  vectors  ^  ,  £  ,  .  .  .  ,  ci   which  are  the  columns  of  Q,  a  pxr  matrix. 
That  is, 

Q  =  [%   £2  •  •  •  ^1  =  [-^11   -^21  •  •  •  -^1^  ^ 

Using  this  notation,  the  results  of  this  section  can  be  summarized 
as  follows:   the  problem  of  designing  a  minimal  order  (minimal  order  ar- 
bitrary, or  intermediate  order)  observer  for  the  feedback  control  law 
(4.2)  of  system  (4.1)  reduces  (for  all  practical  purposes)  to  that  of 
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finding  matrices  A,  Q,  and  D  that  satisfy  (4.17)  (in  view  of  (4.32a) 

and  (4.33)),  subject  to  A  having  stable  (or  arbitrary)  eigenvalues  and 

p  being  minimal  (or  intermediate).    It  is  shown  in  the  next  section 

that  this  statement  is  equivalently  expressed  by  Definition  (2.5) 

(Definition  (3.1),  or  Definition  (3.2)),  slightly  modified. 

Observer  Design  as  a  Partial 
Realization  Problem 

It  is  shown  below  that  the  developments  of  the  preceding  section 
lead  naturally  to  a  reformulation  of  an  observer  design  problem  as  a 
partial  realization  problem.   This  renders  the  results  of  the  preceding 
chapters  (and  of  realization  theory  in  general)  applicable  to  a  previously 
unrelated  problem.   It  is  also  shown  that  as  a  consequence  of  the  possi- 
ble disparity  in  values  of  the  observability  indices  of  (F,H)  ,  a  finite 
matrix  sequence  which  arises  from  an  observer  design  problem  generally 
has  one  or  more  matrix  elements  with  one  or  more  unspecified  columns. 
At  first  glance,  it  may  seem  that  the  presence  of  unspecified  columns 
in  the  matrices  of  the  sequence  create  complications  when  obtaining  a 
realization  of  the  sequence,  but  it  is  shown  in  the  next  section  that 
this  is  not  the  case. 

The  following  theorem  is  the  most  significant  single  result  of  this 
dissertation. 

(4.34)   Theorem.   System  (4.5)  is  an  observer  for  the  feedback  control 

law  (4.2)  of  system  (4.1)  if  and  only  if  (F,H)   is  a 
completely  observable  pair,  matrices  T,  B,  C,  and  E 
are  calculated  using  (4.32),  (4.8a),  (4.14),  and 
(4.15),  respectively,  and  matrices  A,  Q,  and  D  satisfy 
the  following  conditions 
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a)  L^  =  DA^  ^Q  i  =  1,2 No 

b)  all  the  eigenvalues  of  A  have  negative  real 
parts. 

Matrix  L.  is  dimensioned  mxr  and  has  its  i th  column 
equal  to  the  (\)^+\j^+...    +u._j^+i)th  column  of  K  for 
U.  >^  i,  and  unspecified  for  0   <  i. 
Proof.   It  suffices  to  shown  that  (4.34a)  is  equivalent  to  (4.17);  the 
rest  follows  from  Theorem  (4.8)  and  the  developments  of  the  preceding 
section. 

Label  the  columns  of  K.  as  follows 

12  r 

From  Definition  (4.23)  and  Corollary  (4.24)  it  follows  that  No  =  U  = 

max(u  ).   Now  define  a  set  of  vectors  {£..}  for  i  =  l,2,...,r  and  i  =  1, 

1 , . . . ,No  as 

I  k. .     if  u.  ^  i 

(4.36)  £..  =•{   ^'"        ^   ~ 

^'"     *      if  u.  <  i 

where,  as  before,  an  asterisk  represents  an  unspecified  element.   Then, 
in  view  of  (4.17),  (4.28),  (4.33),  and  (4.35)  it  is  true  that  these 
vectors  satisfy  the  relations  given  next: 

<^-37)         l-i  =  DA^-^t.^  =  DA^-^.  j  =  1,2,... ,r 

i  =  1, 2, . . . ,U. 
Also  since  I        is  unspecified  for  i  >  u.,  then  the  left-hand  side  of 

(4.37)  for  u  +  1  ^  i  ^  u  =  No  can  be  set  equal  to  whatever  value  matches 
a  given  right-hand  side.   Finally,  (4.34a)  follows  by  defining  _£. .  to  be 
the  jth  column  of  L..  y 

Consider  now  the  following  corollary  to  Theorem  (4.34). 

(4.38)  Corollary.   The  allowable  sets  of  (stable)  poles  for  an  observer 

(A,B,C,D,E)   for  the  feedback  control  law  (4.2)  of 
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system  (4.1)  are  determined  exclusively  by  the  out- 
put structure  of  system  (4.1)  and  matrix  K  . 
Proof.   Follows  directly  from  (4.34a).  V 

(4.39)  Remark.   The  form  (4. 26)- (4. 27)  adopted  for  the  pair  (F^^,F^2)n-r 
can  be  viewed  as  a  partitioning  of  (4.21a)  into  r  subsystems  coupled  to 
each  other  in  both  directions,  with  the  ith  subsystem  completely  observa- 
ble from  the  ith  system  output. 

The  partition  defined  on  K  in  (4.1)  assigns  the  gain  matrix  K   to 
the  states  x.    and  the  gain  matrix  K   to  the  states  X2  (available  directly 
at  the  output).   It  follows  that  if  K  =  0  an  observer  is  not  necessary. 
A  finite  matrix  sequence  constructed  from  an  observer  design  problem 
where  K  =  0  is  a  null  sequence,  and  such  sequences  are  generally  mean- 
ingless (as  argued  in  Chapter  2). 

In  the  sequel,  the  vectors  k.,,k.„,  ,..,  k    in  (4.35)  are  re- 
ferred  to  as  the  jth  chain  of  matrix  K^ .   It  is  important  to  notice  that 
a  chain  of  K.  composed  of  null  vectors  implies  that  the  states  in  the 
corresponding  subsystem  of  (4.21a)  are  not  required  for  feedback.   It 
is  shown  subsequently  that  the  occurrence  of  a  null  chain  in  K  may  lead 
to  a  reduction  in  the  dimension  of  the  required  observer.  V 

Before  proceeding  any  further  it  is  convenient  to  adopt  the  following 
notational  conventions. 

(4.40)  Notation.  In  the  preceding  two  chapters,  the  letter  k  represen- 
ted an  integer  subscript  and  was  associated  with  the  columns  of  the  ele- 
ments of  a  matrix  sequence  (among  other  things).  But  since  K  represents 
a  feedback  matrix  in  this  chapter,  the  letter  i  will  be  used  in  place 

of  k  as  a  subscript  in  discussions  where  matrix  K  (or  its  elements)  are 
directly  involved  (as  in  Theorem  (4.34)  and  its  proof). 


128 


As  before,  an  asterisk  (*)  represents  an  unspecified  element 
(whether  ic  is  a  matrix  or  a  column  of  a  ;iiatrix).   Occasionally  llunij'.li, 
it  may  be  necessary  to  refer  to  a  certain  unspecified  element.   In  such 
situations,  a  vector  C. .  or  a  scalar  ?.  is  used,  and  the  intended  mean- 
ing should  be  clear  from  the  context.  V 

Theorem  (4.34)  is  significant  because  it  reduces  an  observer  design 
problem  to  a  single  equation,  the  solution  of  which  can  be  obtained 
through  (partial)  realization  theory,  an  area  that  has  been  extensively 
studied  in  control  theory  and  other  fields  (see  Chapter  1).   From 
another  point  of  view,  it  provides  an  application  for  realization  theory 
and  suggests  several  possibilities  for  future  research  in  this  area, 
because  a  realization  problem  that  appears  meaningless  or  useless  in 
the  realization  context  can  have  significant  implications  in  the  obser- 
ver design  context. 

Corollary  (4.38)  also  has  important  implications.   Since  the  actual 
values  of  the  elements  of  F,  G,  and  H  do  not  enter  into  the  equation 
that  must  be  solved  for  matrix  A,  it  is  then  possible  to  study  the  sets 
of  p  stable  poles  that  can  observe  a  given  feedback  control  law  for  a 
class  of  systems  that  have  the  same  output  structure,  and  other  related 
problems.   An  example  is  given  at  the  end  of  this  chapter  to  illustrate 
these  concepts. 

Generally,  a  partial  matrix  sequence  which  is  formed  with  the  columns 
of  K^  has  one  or  more  of  its  matrix  elements  with  one  or  more  unspecified 
columns.   As  a  matter  of  fact,  it  follows  from  (4.36)  that  this  will 
occur  unless  '-'1  =  ^2=  ...  =  u^  =  u  =  No  (which  corresponds  to  the  case 
where  n  =  rv) .   A  partial  matrix  sequence  that  has  one  or  more  of  its 
matrix  elements  with  some  unspecified  columns  is  referred  to  as  an  Incom- 
pletely specified  finite  (or  partial)  matrix  sequence. 


129 


As  a  result  of  Theorem  (4.34),  the  partial  realization  theory  dis- 
cussions and  results  of  the  two  preceding  chapters  can  be  used  to  design 
a  low  order  (minimal,  minimal  with  arbitrary  poles,  or  intermediate)  ob- 
server for  a  given  feedback  control  law.   The  realization  theory  result 
corresponding  to  a  specific  observer  design  problem  is  obvious  (for  ex- 
ample, a  minimal  order  observer  is  designed  using  Algorithm  (3.42),  the 
minimal  partial  stable  realization  algorithm);  however,  several  of  the 
comments  and  results  in  Chapters  2  and  3  need  to  be  interpreted  differ- 
ently in  the  observer  design  problem  context,  and  some  considerations 
have  to  be  taken  into  account  when  a  partial  realization  is  sought  for 
an  incompletely  specified  finite  matrix  sequence. 

Partial  Realizations  in  the 
Observer  Design  Context 

The  problem  of  realizing  an  incompletely  specified  finite  matrix 

sequence  with  a  system  of  the  form  (2.1)  is  discussed  next,  and  then 

partial  realization  theory  is  applied  to  the  specific  situation  of  an 

observer  design  problem. 

Consider  an  incompletely  specified  finite  sequence  {L,,L„,...,L   } 

12      No 

of  mxr  matrices  together  with  its  corresponding  Hankel  matrix  K 

No  No 

The  dimension  of  the  minimal  realization  of  the  sequence  is  given  by  the 
lowest  rank  that  ^^^^^    can  possibly  attain  after  the  unspecified  elements 
are  replaced  by  (appropriately  chosen)  numbers,  and  a  minimal  realiza- 
tion can  be  obtained  by  applying  any  one  of  several  realization  algorithms 

available  in  the  literature  to  the  full  Hankel  array  3f ,  „  .   The  results 

■'      No  No 

of  Chapter  2  show  that  a  more  convenient  and  efficient  way  is  to  iden- 
tify the  recurrence  relations  (2.22)  that  hold  for  the  columns  of  Jf 

No  No 

as  done  in  Algorithm  (2.78). 
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For  a  lompleLcl y  specified  finite  matrix  sequence.  Step  1  ol  Al- 

r.oritlini  (2.78)  gives  the  dimension  o[     the  minimal  real! /.at  ion  ani!  I  li.- 

two  sets  of  invariants  {lJ.„)  and  [1.,   ).   However,  when  the  selection 

iM       —  1 K 

procedure  of  Step  1  of  Algorithm  (2.78)  is  applied  to  the  columns  of 
the  Hankel  array  corresponding  to  an  incompletely  specified  finite  ma- 
trix sequence,  the  question  of  linear  dependence  of  a  column  on  the  pre- 
ceding columns  depends  on  the  specific  values  substituted  for  some  of 
I  lie  unspecified  elements.   This  implies  that  the  set  of  minimal  control- 
lability indices  of  an  incompletely  specified  finite  matrix  sequence 
may  not  be  unique.   On  the  other  hand,  assigning  numerical  values  to  the 
unspecified  elements  without  a  rule  (such  as  the  recurrence  relations 
(2.22))  is  not  easy  to  do,  may  yield  a  non-minimal  realization,  and 
usually  wastes  degrees  of  freedom  for  the  locations  of  the  realization 
poles. 

One  approach  to  solve  the  problem  is  to  write  the  recurrence  rela- 
tions (2.22)  for  every  candidate  set  of  minimal  controllability  indices 
and  solve  for  the  coefficients.   This  is  not  easily  accomplished  either 
because  these  equations  may  include  products  of  the  unspecified  elements 
in  the  matrix  sequence  and  the  unknown  coefficients  {y..,),  thus  making 
L he  equations  nonlinear.   All  of  these  formidable  complications  can  be 
avoided  completely  if  the  realization  problem  is  considered  via  the  dual 
approach. 

Observe  that  if  ?.  ,  is  unspecified,  then  ■  . ,  ,,,...,)?...,   are  also 
-jk       '^  -jk+1     -J  No 

unspecified.   Consequently,  the  unspecified  elements  in  the  columns  of 
'i(.,  .,     occur  always  in  the  last  positons.   So,  if  the  rows  rather  than 

Mo  INo 

the  columns  of  'K  are  examined  for  linear  dependencies,  then  the  un- 

No  No  ^  ' 

specified  elements  are  treated  exactly  as  before.   In  conclusion,  the 
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observability  indices  of  the  minimal  realization  of  an  incompletely  spe- 
cified finite  matrix  sequence  are  unique,  while  the  minimal  controlla- 
bility indices  are  not,  and  a  simple  way  to  realize  such  a  sequence  is 
using  the  dual  of  the  corresponding  algorithm  in  Chapters  2  and  3.   Notice 
that  if  rows  instead  of  columns  of  the  L.  matrices  were  unspecified, 
then  the  algorithms  of  the  preceding  chapters  should  be  used  directly 
(not  in  dual  form) . 

It  is  difficult  to  carry  out  the  preceding  discussions  in  a  more 
concrete  form  without  referring  to  a  specific  example. 
(4.41)   Example.   It  is  desired  to  obtain  the  minimal  realization  (in 
its  most  general  form)  of  the  following  partial  sequence 


h   = 


1  0 

0    1 
0    0 


s  = 


c 


121 


'122 


? 


123 


0 
0 

1 


S  = 


K 
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'132 


? 


133 


-1 
1 
2 


The  variables  i^^^y.}   denote  the  elements  of  the  unspecified  columns  £ 
=  _C^2  ^"'^  iij3  =  ^23"  ^^^^   sequence  could  have  been  obtained  from  the 
specifications  of  a  minimal  order  observer  design  problem  for  a  sixth- 
order  plant  with  three  inputs  and  two  outputs,  and  observability  indices 
v^  =  2,  v^  =  4. 

The  Hankel  array  for  the  given  sequence  is 


132 


?f_ 


33 


1 

0 

^121 

0 

0 

1 

^122 

0 

0 

0 

^123 

1 

^121 

0 

^131 

-1 

^122 

0 

^132 

1 

^123 

1 

^133 

2 

^131 

-1 

* 

* 

^132 

1 

* 

* 

^133 

2 

* 

* 

■131 


'132 


'133 


-1 
1 
2 
* 


Examining  the  columns  of  Jf^^  it  is  found  that  the  minimal  rank  can  be 
as  low  as  three  if  ^^^  and  £^^  are  chosen  appropriately.   But  it  is  also 
found  that  such  a  choice  is  not  unique;  if  E,  =   0,  then  y   =  1  and 

^2  =  2,  while  if  ^^^3  ^   0.  then  y^  =  2  and  y^  =  1.   Consider  first  the 
choice  of  structure  y^  =  1  and  y^  =  2.   The  equations  that  must  be 


solved  are  given  by 

^121 

^122 
0 

-1' 

1 

2 


1 
0 
0 


111 


121 


1  0  0 
0  1  0 
0    0    1 


'211 


Y 


221 


'222 


The  realization  is  immediately  obtained  as  the  following  triple 


A  = 


-^111 

"^121 
0 


0 
0 

1 


-1 
1 
2 


0 
1 
0 


D  = 


1  0  0 
0  1  0 
0    0    1 


133 


where  Y, ,  i  and  Y,-^,  are  arbitrary.   This  fixes  ^  „  and  j^   to  be 


^12  =  f-^Ul 


^T   ^  J-  2 
^13    ^^111 


-Y 


121 


0] 


^111^121 


-^121^ 


It  can  be  easily  shown  that  this  realization  has  two  arbitrary  poles 
while  the  third  pole  is  always  unstable. 

Consider  now  the  choice  of  structure  y  =  2  and  y„  =  1.   The  per- 


tinent equations  to  be  solved  are 

1     5 


'131 


c 


132 


'133 


0 
0 


e 


121 
122 
123 


0 
1 
0 


HI 


112 


121 


1 
0 
0 


'121 


'122 


'123 


0 
1 
0 


'211 


'212 


'221 


The  realization  corresponding  to  this  structure  is  given  by  the  triple 


A  = 


0 
1 
0 


111 


-Y 


-Y 


112 


121 


-Y 


211 


-Y 


212 


-Y 


221 


Q  = 


1  0 
0  0 
0    1 


where 


D  = 


1 
0 


'121 


'122 


'123 


Y 


111 


^121^133 
^123 


-  K 


131 


Y 


211 


'121 

'123 


121 


^122^133 
^123 


-  C 


132 


Y 


212 


'123 


112 


'133 
'123 


'221 


'122 
'123 
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with  C,„„  ^  0  and  the  remaining  C^ .,  elements  arbitrary.   It  can  also  be 
123  ijk 

shown  that  the  available  degrees  of  freedom  are  sufficient  to  guarantee 

arbitrary  poles  for  this  realization. 

Consider  now  the  dual  of  the  realization  procedure  in  Algorithm 

(2.78).   Inspecting  the  rows  of  K       it  is  noticed  that  the  dimension  of 

the  minimal  realization  is  equal  to  three  and  5,,,  =  6„  ,  =  5^   =1.  The 

IM    2M    3M 

pertinent  equations  to  be  solved  in  this  case  are 


[0    1]  =  -  [9^^^    9^2,    9^3^] 


[0    -1]  =  -  [9^^^    9^21    9,31]    0  0 

1  0 

0  1 

'0  o" 

1  0 

[1    2]  =  -  [93^^    932^    933^]  To  0- 

1  0 

0  1 

and  the  realization  is  given  in  its  most  general  form  by  the  triple 


111 


211 


0    -1 


0     1 


1 


D  = 


311 

"1       0  0" 

0    1  0 

0    0  1 


Q  = 


"1 

0" 

0 

1 

0 

0 

. 

_ 

where 


be 


'ill'  ®211'  ^"^  ^311  ^^^   arbitrary.   This  fixes  i        and  g        to 


4  =  [-^11   -9211   -^311^ 
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^13  =  ^^111+^311   ^11^211^^311   ^U^lrtn-^^U^ 
It  is  easy  to  show  that  the  realization  poles  are  completely  arbitrary. 

The  controllability  matrix  for  this  realization  is 

•l    0    -6^^^    0- 

0       1       -e^^^       0 

0    0    -9„,,     1 


C  =  [Q   AQ]  = 


As  before,  the  controllability  indices  are  {2,1}  if  6    i   0,  or  {1,2} 
if  63^^  =  0. 

Notice  that  the  dual  procedure  has  given  the  same  number  of  degrees 
of  freedom  for  the  positions  of  the  realization  poles  and  the  same  in- 
formation about  the  sets  of  minimal  controllability  indices,  while  re- 
quiring a  considerably  smaller  amount  of  effort  and  bookkeeping.        V 

Several  of  the  partial  realization  theory  results  of  Chapter  3  are 

examined  next  in  the  observer  context.   The  following  remark  opens  the 

discussion. 

(4.42)   Remark.   Consider  a  triple  (A,Q,D)   which  represents  a  partial 

realization  of  a  finite  matrix  sequence  that  was  defined  as  a  result  of 

an  observer  design  problem.   Then  the  observability  indices  of  the  pair 

(A,D)   are  also  the  observability  indices  of  the  observer  system,  but 

the  controllability  indices  of  the  pair  (A,Q)   are  not  the  controllabil- 

P 

ity  indices  of  the  observer  system.   The  controllability  indices  of  the 

observer  are  those  of  the  pair  (A, [B   C] )  .   There  is  no  apparent  reason 

to  believe  that  the  controllability  indices  of  (A,Q)   and  (A, [B   C] ) 

P  P 

are  related  in  any  meaningful  way.  V 

To  design  a  minimal  order  observer  for  a  given  feedback  control 
law  and  plant  using  partial  realization  theory,  the  appropriate  algo- 
rithm to  use  is  the  dual  of  Algorithm  (3.42)  (the  minimal  partial  stable 
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ser- 
on 

from 


realization  algorithm).   Of  all  the  results  given  in  Chapter  3,  those 
related  to  the  minimal  partial  stable  realization  problem  are  the  weak- 
est.  Correspondingly,  the  minimal  order  observer  design  problem  has  th 
weakest  results.   For  example,  it  seems  to  be  practically  impossible 
to  know  the  dimension  of  the  minimal  order  observer  without  obtaining 
the  triple  (A,Q.D)^  first  and  calculating  the  eigenvalues  of  A.   Only 
some  bounds  for  the  dimension  of  the  minimal  order  observer  can  be 
stated.   This  is  discussed  in  the  following  remark. 
(4.43)   Remark.   A  bound  for  the  dimension  of  the  minimal  order  ob 
ver  has  been  given  in  Lemma  (4.18).   Viewed  from  the  partial  realizati 
formulation  of  an  observer  design  problem,  it  is  apparent  that  bound 
(4.19)  is  not  too  strong  in  general.   Another  bound  can  be  derived  f 
Theorem  (3.31)  and  its  vector  sequence  counterparts.  Theorems  (3.27) 
and  (3.28).   It  consists  of  obtaining  the  smallest  value  of  p  for  which 
conditions  (3.31a)  and  (3.31b)  are  satisfied  for  the  partial  sequence 
formed  from  the  specifications  of  a  minimal  order  observer  design  prob- 
lem.  I^is  bound  is  also  considerably  weak  because  these  two  conditions 
are  necessary  but  not  sufficient  for  a  partial  realization  to  be  stable. 
The  strongest  bound  readily  available  is  given  by  the  minimal  rank  of 
•\no-   That  is,  the  dimension  p  of  a  minimal  order  observer  satisfies 
the  following  inequality 

"•"="  f<\N.>  -  calculated  using  the  dual  for.  of  Step  1  of  Algorlth. 
(2.78).   This  bound  is  actually  satisfied  in  a  large  number  of  cases. 
A  good  rule  to  follow  is  to  compute  the  bound  (4.U)  and  verify  whether 
0.31a)  and  (3.31b)  are  satisfied  or  not  for  this  value  of  p. 
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Rothschild  and  Grammatlcos  (1971)  have  given  (without  proof)  the 
following  bound  for  the  dimension  of  a  minimal  order  observer  for  a 
given  feedback  control  law  and  plant 

(4.45)  p  >  "^^"  -  ^^ 

=  m  +  r 

The  derivation  of  this  bound  is  supposed  to  have  been  made  under  the 
assumptions  that  matrix  A  is  specified  and  that  it  has  no  eigenvalues 
in  common  with  matrix  F.   It  is  intuitively  clear  that  some  degrees  of 
freedom  are  lost  by  introducing  these  two  assumptions  and,  consequently, 
(4.44)  should  be  a  stronger  bound  in  many  cases. 

Based  on  the  discussions  in  Chapter  3  with  respect  to  the  value  of 
p  ,  it  seems  to  be  quite  difficult  to  obtain  a  stronger  bound  than  (4.44). 
On  the  other  hand,  the  bound  (4.44)  requires  considerably  more  computa- 
tions than  the  other  three  bounds  mentioned  here.  V 

The  appropriate  algorithm  to  use  in  designing  an  intermediate  order 
observer  using  partial  realization  theory  is  the  dual  of  Algorithm  (3.36). 
As  in  the  case  of  minimal  order  observers,  not  much  can  be  specifically 
said  about  intermediate  order  observers.   But  there  are  two  significant 
points  that  should  be  discussed. 

(4.46)  Remark.   It  is  possible  that  intermediate  order  observers  of  a 
specific  dimension  do  not  exist  at  all  for  a  given  feedback  control  law 
and  plant.   This  is  a  consequence  of  the  fact  that  a  partial  realization 
of  a  specific  dimension  may  not  exist  for  a  given  finite  matrix  sequence 
(see  Remark  (3.35)).   A  further  complication  is  that  there  is  no  way  of 
knowing  beforehand  whether  such  a  condition  arises  or  not  in  a  given  pro- 
blem. V 

(4.47)  Remark.   Given  that  an  intermediate  order  observer  of  a  specific 
dimension  exists,  the  number  of  arbitrary  poles  it  has  is  not  easily 
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determined  in  general.   A  good  estimate  consists  of  the  number  of  ar- 
bitrary {9..,}  (or  {y.      ])    parameters  in  A.  V 

The  stronger  results  available  for  the  minimal  partial  arbitrary 
realization  problem  correspondingly  yield  strong  results  (in  the  form 
of  necessary  and/or  sufficient  conditions)  for  the  problem  of  designing 
minimal  order  observers  with  arbitrary  poles.   The  most  significant  re- 
sults that  can  be  adopted  from  Chapter  3  through  Theorem  (4.34)  are 
stated  in  the  following  theorems. 
(4.48)   Theorem.   A  p-dimensional  observer  which  estimates  the  feedback 

control  law  Kx  for  a  single  output  system  (4.1)  has 

arbitrary  poles  if  and  only  if 
(A. 49)  p  >  V  -  1  =  n  -  1 

Proof.   Follows  readily  from  Theorems  (4. 34)  and  (3.10).  V 

(4.50)  Theorem.   A  p-dimensional  observer  which  estimates  the  feedback 

T 
control  law  k  x  for  a  multiple  output  system  (4.1)  has 

arbitrary  poles  if  and  only  if 

(4.51)  p  >  V  -  1 

=  a 

where  v^  -  1  <  v  -  1  is  the  length  of  the  longest 

T 
non-zero  chain  of  k    . 

Proof.   In  view  of  Theorem  (4.34),  it  suffices  to  show  that  a  triple 

T 
(A,Q,d  )p  which  realizes  a  finite  sequence  of  r-dimensional  row  vectors 

formed  from  a  given  (n-r)-dimensional  row  vector  k'J'  has  aribtrary  poles 

if  and  only  if  (4.51)  is  satisfied.   In  this  proof  it  is  assumed  that 

the  observability  indices  of  (F,H)^  are  arranged  in  non-increasing 

fashion,  and  the  last  r  -  a  +  1  indices  are  considered  to  be  equal  to 

each  other;  that  is,  v=v>v„>...>v,>v=v    =       =v 

1  -  2  =      =  ot-1  =  a    a+1   •  •  •   ^r* 
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It  is  well  known  (Kalman,  1971a)  that  no  loss  of  generality  is  involved 
in  assuming  the  observability  indices  of  the  plant  to  be  arranged  in  non- 
increasing  fashion.   The  assumption  concerning  the  equality  of  the  last 
r  -  a  +  1  observability  indices  is  not  necessary  for  the  proof  and  can 
be  easily  removed.   Both  of  these  assumptions  are  introduced  exclusively 
for  notational  simplicity. 

Sufficiency.   Suppose  that  the  first  a  -  1  (for  some  integer  1  £  a  ^  r) 

T 
chains  of  k.  are  zero;  that  is, 

11    12         lu,    21         a-lu  , 

1  a-1 

This  makes  ^q.   ^  ^^  ~    1  be  the  length  of  the  longest  non-zero  chain  of 

T 
k.^ .   The  corresponding  row  vector  sequence  formed  according  to  Theorem 


(4.34)  is  given  by 


4  =  [0  ...  0   k^i  .  .  .  k^^] 
4  =  [0  ...  0   k^2  •  •  •  ^2^ 


(4.52) 


^'i  = 

=    [0    .    . 

,    .    0 

k           .    , 

.    .   k       ] 

^ 

au 

ru 

a 

a 

a 

C^  =  [0  .  .  .  0    *...*]  i  =  U  +l,...,No 

—1  a 

The  extension  sequence  is  unspecified,  so  the  first  a-1  elements 
of  every  vector  in  the  extension  sequence  can  be  set  equal  to  zero.  That 
is,  the  extension  sequence  is  chosen  in  the  form 

(4.53)         cj  =  [0  .  .  .  0   *...*]  i  =  No+1,... 

Consider  now  the  dual  of  equation  (3.11)  with  the  vectors  in  (4.52)  and 
(4.53).   This  is  the  following  equation 

^'•''^  4^1^r  =  -  X^i-^T  T  =  0,1,2,... 
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Observe  that  for  the  first  a  -  1  elements  of  the  vectors  (r^  r^    ] 
equation  (4.54)  reads  0  =  0  with  any  p  >  0  and  any  set  of  p  coefficients 
\}.      Observe  also  that  for  p  >  u^  =  v^  -  1  the  last  r  -  a  4-  1  ele- 
ments of  the  vectors  in  the  right-hand-side  of  (4.54)  are  unspecified. 
Thus,  if  (4.51)  is  satisfied,  the  unspecified  (non-zero)  elements  of  the 
extension  sequence  can  be  chosen  to  satisfy  (4.54)  for  any  given  set  of 
P  coefficients  {&^} .      Finally,  the  realization  is  constructed  in  the 
dual  of  form  (3. 12)- (3. 14) . 

Necessity.   This  part  of  the  proof  is  omitted  because  it  is  the  exact 
dual  of  the  necessity  part  of  the  proof  of  Theorem  (3.10).  y 

These  two  theorems  sharpen  the  available  results  in  the  problem  of 
designing  minimal  order  observers  with  arbitrary  poles  for  single  output 
plants  and  for  multiple  output  plants  where  k^x  is  to  be  estimated.  The 
sufficiency  part  of  Theorem  (4.48)  is  well-known  (Luenberger,  1964,  1966, 
1971),  but  the  necessity  part  has  not  been  proven  elsewhere.  Williamson 
(1970)  recently  demonstrated  the  sufficiency  part  of  Theorem  (4.50), 
but  not  the  necessity  part.   Theorem  (4.50)  is  an  excellent  example  of 
the  fact  that  the  occurrence  of  a  null  chain  in  K^  can  lead  to  a  reduc- 
tion in  the  order  of  the  required  observer. 

The  corresponding  results  for  multiple  input/output  plants  are 
given  in  the  following  two  dual  theorems. 

(4.55)   Theorem.   If  a  quintuple  (A.B.CD.E)^  defines  an  observer  with 
arbitrary  poles  for  the  feedback  control  law  Kx  of  a 
multiple  input/output  plant  (F,G,H)^,  then  its  dimen- 
sion and  the  controllability  indices  {p.}  of  the  asso- 
ciated matrix  pair  (A.Q)^  satisfy  the  following  con- 


straints; 
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iM=i=  1  -I-   -    i-,^, .  .  .  ,r 


iM  =  "i  =  ^i 
r 

1 


b)  p    <   a  -      J    ()(M.) 
i=l 


c)  p   <   min(n-r,in(v-l)) 
where  {y_.^}  is  the  set  of  minimal  controllability  in- 
dices of  the  finite  matrix  sequence  formed  from  K, 

{v^}  is  the  set  of  observability  indices  of  (F,H) 

n ' 

a  is  defined  by  the  set  {p_.}  through  (2.23)  and  (2.51), 
and  M^  is  defined  in  Step  2  of  Algorithm  (2.78). 
Proof.   The  lower  bound  in  condition  (4.55a),  condition  (4.55b),  and 
the  bound  p  <  m(v  -  1)  =  mNo  follow  from  Theorems  (4.34)  and  Corollary 
(3.23).   The  upper  bound  in  condition  (4.55a)  and  the  bound  p  <  n  -  r 
are  obtained  from  well-known  sufficiency  results  in  the  desing  of  obser- 
vers with  arbitrary  poles  (see,  for  example,  Luenberger,  1964,  1966, 
1971,  or  Gopinath,  1971), 

In  view  of  Remark  (4.42),  the  dual  of  Theorem  (4.55)  is  different 
enough  to  deserve  specific  mention. 

(4.56)   Theorem.   If  a  quintuple  (A,B,C,D,E)p  defines  an  observer  with 
arbitrary  poles  for  the  feedback  control  law  Kx  of  a 

multiple  input/output  plant  (F,G,H)  ,  then  its  dimen- 

n 

sion  and  its  observability  indices  {5.}  satisfy  the 
following  constraints: 

a)  6..  <  6.  <  V  -  1  ,-^19 

iM=i=  i-i,/,...,m 

b)  p  ^  K  -  I   p(R.) 

i=l   ^ 

c)  p  £  inin(n-r,m(v-l)) 
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where  {6.,,}  is  the  set  of  minimal  observability  indi- 
xM 

ces  of  the  finite  matrix  sequence  formed  from  K,  \)   is 

the  observability  index  of  (F,H)  ,  and  k   and  the  ma- 

trices  R.  are  the  dual  of  a  and  the  matrices  M.,  re- 
1  1 

spectively. 
Proof.   Follows  by  duality.  V 

These  two  theorems  provide  a  set  of  necessary  conditions  and  suffi- 
cient conditions  for  a  minimal  order  arbitrary  observer  to  estimate  a 
given  feedback  control  law  of  a  specified  plant.   Conditions  (4.55b), 
(4.56b),  and  the  lower  bounds  on  (4.55a)  and  (4.56a)  are  necessary  con- 
ditions, while  (4.55c),  (4.56c),  and  the  upper  bound  on  (4.55a)  and 
(4.56a)  are  sufficient  conditions.   The  sufficient  conditions  are  well 
known  (Luenberger,  1964,  1966,  1971;  Jameson  and  Rothschild,  1971; 
Wolovich,  1973a),  but  the  necessary  conditions  stated  in  the  theorems 
are  not  available  elsewhere.   This  makes  the  contribution  of  the  theo- 
rems be  significant  because  sufficient  conditions  are  generally  more 
conservative  than  necessary  conditions  in  the  following  sense. 

Consider  the  problem  solved  in  Example  (3.43).   Suppose  that  the 
partial  sequence  was  obtained  as  a  formulation  of  a  minimal  partial  rea- 
lization problem  from  a  minimal  order  observer  design  problem  for  a  two- 
input  ,  two-output,  tenth-order  system  with  observability  indices  v  =  v 
=  5.   The  sufficient  conditions  of  Theorems  (4.55)  and  (4.56)  give  p  =  8, 
U-,    =  ^2  ~   ^>  and  6  =  6„  =  4  for  the  dimension  and  structure,  respectively, 
of  an  arbitrary  realization.   However,  it  can  be  shown  that  all  partial 
realizations  of  dimension  equal  to  6  have  arbitrary  poles  and  observabil- 
ity indices  given  either  by  {4,2}  or  {3,3},  depending  on  the  specific 
values  chosen  for  the  arbitrary  {y. .,  }  parameters. 
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It  is  evident  that  Theorems  (4.55)  and  (4.56)  are  not  as  strong  as 
Theorems  (4.48)  and  (4.50).   However,  there  are  reasons  to  believe  that 
this  is  not  necessarily  a  deficiency.   It  is  strongly  suspected  that  the 
conditions  listed  in  these  theorems  are  the  best  one  can  do  without  con- 
sidering a  detailed  analysis  of  the  problem  for  all  possible  feedback  con- 
trol laws  for  a  given  system.   The  example  given  at  the  end  of  this  chap- 
ter lends  support  to  this  claim   (see  also  Remark  (4.82)). 

Keeping  in  mind  the  results  discussed  in  this  chapter,  the  algorithms 
outlined  in  Chapter  3  can  conceivably  be  used  to  obtain  all  intermediate 
order  observers  of  a  specified  dimension,  all  minimal  order  observers, 
and  all  minimal  order  arbitrary  observers  for  a  given  feedback  control 
law  and  plant.   Another  problem  that  can  be  studied  is  that  of  obtaining 
the  class  of  feedback  control  laws  that  can  be  observed  by  a  given  ob- 
server for  a  given  plant,  or  by  an  observer  of  specified  dimension  and 
output  structure  but  unspecified  dynamics  for  a  given  plant.   Other  simi- 
lar (and  perhaps  less  ambitious)  problems  could  also  be  easily  proposed. 
An  example  given  in  the  sequel  considers  some  of  these  problems  for  a 
specific  case. 

The  partial  realization  approach  to  observer  design  also  serves  to 

provide  a  unified  framework  for  studying  and  evaluating  other  observer 

design  procedures.   This  is  considered  next. 

Partial  Realization  Equivalent 
of  Other  Observer  Designs 

The  partial  realization  algorithms  corresponding  to  some  of  the 

currently  available  (full-state  and  intermediate  order)  observer  design 

methods  are  studied  in  this  section.   Specifically,  the  full-state 

observer  designs  of  Luenberger  (1966),  Gopinath  (1971),  and  Munro  (1973, 
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1974)  are  considered,  along  with  the  intermediate  order  observer  designs 
(for  a  given  feedback  control  law  Kx)    of  Fortmann  and  Williamson  (1972) 
and  Murdoch  (1974). 

There  are   several  other  (both  full-state  and  intermediate  order) 
observer  design  procedures  that  may  correspond  with  a  partial  realization 
procedure.   Notably  among  these  other  procedures  are  the  full-state 
observer  design  of  Bongiorno  and  Youla  (1968),  the  full-state  observer 
design  (via  the  transfer  function  matrix  approach)  of  Retallack  (1970), 
the  intermediate  order  (of  dimension  equal  to  m(v  -  1))  observer  design 
of  Jameson  and  Rothschild  (1971),  the  intermediate  order  (of  dimension 
equal  to  ra(v  -  1))  observer  design  (via  the  matrix-fraction  description 
approach)  of  Wolovich  (1973a),  and  the  minimal  order  (not  always  stable, 
though)  observer  design  (via  the  matrix-fraction  description  approach) 
of  Wang  and  Davison  (1973).   The  correspondence  (if  any  at  all)  of  these 
observer  design  techniques  with  a  partial  realization  formulation  of  the 
problem  is  not  obvious  and  remains  to  be  investigated. 

(4.57)  Full-state  observer  design  of  Luenberger  (1966)  and  Munro  (1973, 
1974).   This  observer  design  relates  to  a  simple  (but  non-minimal)  par- 
tial realization  algorithm.   The  main  idea  involved  in  the  observer  de- 
sign is  the  following.   Consider  (without  loss  of  generality)  the  plant 

(4.1)  to  be  given  with  the  pair  (F,H)   in  the  form  (4. 26)-(4. 27) ,  with 

n 

(4.58)  f^  =  [f^,    f^.  .  .  .  f"^  ]  i  =  1,2,. ..,r 
—1    — il   — 12       — ir 

where  f..  is  a  v .-dimensional  vector.   In  this  form,  the  plant  may  be 
considered  as  a  parallel  combination  of  single  output  subsystems  coupled 
in  both  directions  by  their  respective  outputs.  Since  all  the  inputs  to 
every  subsystem  are  available,  then  subobservers  can  be  designed  to  esti- 
mate the  state  of  every  one  of  the  single  output  subsystems,  and  the 


145 


overall  observer  is  the  (uncoupled)  parallel  combination  of  all  the  sub- 
observers.   In  equation  form,  the  observer  parameters  are  given  by 


(4.59a) 

T  =   diag(T.) 

(4.59b) 

T.    =    [      I         , 
1                  v.-l 

1 

(4.59c) 

T            r 

^ii   =    f^il 

(4.60a) 

A  =   diag(A. .) 

1 

(4.60b) 

A..    = 
11 

\.-2 

1 

(4.61) 


(4.62a) 


-lii' 


ii2       iiv.-l 

1 


-^ii 


B  =  TG 


-11 


-21 


-12 


-22 


-Ir 


-2r 


(4.62b) 
(4.62c) 
(4.63a) 
(4.63b) 

(4.64a) 
(4.64b) 
where  v.  =  v 


C  = 

'-rl    -r2 
c. .  =  -T.f . .  -  A. .Y. . 

—11       1—11      11-T.l 


c.  .  =  -  T.f. . 


c 
— rr 


D  =  [D^    D^ 


D.  =  [i^    ,, 
1    —V.  1+1 
1-1 


•  D  ] 
r 


-0.  ,+2 
1-1 


•  h.-i^ 


E  =  [e^   £2  •  •  ■ 

e.  =  -  D.Y.  .  +  1/v 
—1      1-^11   —V , 


e  ] 


i  =  1,2, 
i  =  1,2, 


i  =  1,2, 


.  ,  +  V.  for  1  <  i  <  r  with  v„  =  0,  and  the  (v.-l)-dimensional 
1-1     1       =   =         0  1 


vectors  {x- ■}   completely  arbitrary.   Since  the  {^^..l  vectors  are  completely 
arbitrary  then  the  n  -  r  observer  poles  are  completely  arbitrary,  with 
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the  (possible)  exception  that  some  poles  may  assume  only  real  values 
(for  example,  if  v^  -  1  =  v^  -  1  =  3,  then  it  is  not  possible  for  the 
six  observer  poles  to  be  three  complex  conjugate  pairs;  two  poles  must 
be  real).   Luenberger  (1966)  and  Manro  (1973,  1974)  further  impose  the 
condition  that  there  be  no  poles  in  common  between  the  plant  and  obser- 
ver in  order  for  matrix  T  to  be  unique  (see  also  Luenberger,  1964). 
Wonham  (1970)  was  the  first  to  show  that  these  two  restrictions  on  the 
values  of  the  observer  poles  are  unnecessary,  and  that  the  non-uniqueness 
of  T  can  be  handled  favorably. 

The  partial  realization  algorithm  corresponding  to  this  observer 
design  is  the  procedure  outlined  in  the  proof  of  Theorem  (3.22),  modified 
to  have  the  controllability  indices  of  the  pair  (A,Q)    be  the  set 
{y^  :  y.  =  v^  -  1}  instead  of  the  set  {y^  :  y_.  =  No  =  v  -  l}.   This  ob- 
vious modification  is  necessary  because  every  one  of  the  observability 
indices  of  (F,H)^  is  not  generally  equal  to  V. 

From  the  point  of  view  of  partial  realization  theory,  the  restric- 
tions on  the  values  of  the  observer  poles  are  easily  removed.   This  is 
done  by  choosing  matrix  A  in  the  form  (2.55)  rather  than  (4.60).   Only 
one  of  the  equations  (4.59),  (4. 61)-(4. 64)  needs  to  be  correspondingly 
modified:  (4.62c)  is  replaced  by 

(4.62c')       c. .  =  -  T.f . .-Ay 

-ij      x-Ji    ij-Ljj 

The  matrix  Q  for  the  realization  corresponding  to  this  observer  design 
is 


(4.65)         Q  =  [i 


1   -y^+1   -yj+y2+l  *  *  *  4-r-y 


In  an  actual  design,  the  gain  in  degrees  of  freedom  for  the  values  of 
the  observer  poles  has  to  be  properly  weighed  against  the  increase  in 
complexity  of  the  observer.  y 
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(A. 66)  Full-state  observer  design  of  Gopinath  (1971).  The  basic  ideas 
involved  in  this  observer  design  are  the  following.  Consider  the  plant 
(A.l)  with  the  defined  partitions,  and  let  K  =  1  .   Rewrite  (4.8c)  as 


(4.67)         I   =  [D   E] 
n 


T  T 

1  2 

0  I 

r,n-r  r 


T   is  dimensioned  (n-r)x(n-r),  so  it  is  obvious  that  it  must  be  nonsin- 

gular.   The  simplest  choice  is  T,  =  I    .   Then  (4.8a)  and  (4. 14)-(4. 17) 
^  1    n-r 

become 

(4.68)  A  =  F^^  +  T^F^^ 

(4.69)  B  =  G^  +  T^G^ 

(4.70)  C=  y,2^hh2-   hlh   -  V21^2 

(4.71)  D^  =  [I      0     ] 

n-r    n-r,r 

(4.72)  e'^  =  [-T^   I^] 

Observe  that  T„  is  the  only  unknown  in  the  right-hand  side  of  these 
equations.   The  criterion  to  select  T   is  discussed  next. 

Recall  (Lemma  (4.22))  that  (F^,F„  )  _   is  a  completely  observable 

T    T 
pair;  it  follows  by  duality  that  (F,,,F„,)     is  a  completely  controllable 

J  J  11   21  n-r 

T 
pair.   Then,  matrix  T  can  be  chosen  so  that  the  eigenvalues  of 

T    T     T  T 

(4.73)  A  =F^i+F2^T2 

are  given  by  any  specified  set  of  n  -  r  complex  eigenvalues  (with  com- 
plex numbers  occurring  in  conjugate  pairs).   This  result  is  due  to 

T 
Wonham  (1967).   Kalman  (1971a)  has  further  shown  that  the  choice  of  T„ 

T 
to  obtain  a  specified  set  of  eigenvalues  for  A  is  not  unique,  except 

T 
when  F^.  is  a  column  vector.   The  eigenvalues  of  A  are  equal  to  the 

T 
eigenvalues  of  A  ,  so  the  design  allows  completely  arbitrary  observer 

poles.   The  partial  realization  algorithm  corresponding  to  this  observer 

design  is  discussed  next. 
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Label  the  columns  of  T  =  1^_^  as  in  (4.30).   It  follows  from  (4.33) 
that  the  matrix  Q  which  corresponds  to  this  observer  design  is  given  by 
(4.h'))  ,ilso.   I'he  form  of  matrix  A  depends  on  tlie  p.i  r  I  i  <  ii  I  nr  pole  place- 
ment procedure  used  to  compute  T  .   This  means  that  the  pole  placement 
procedure  applied  to  (4.73)  determines  the  partial  realization  algorithm 
applied  to  the  corresponding  realization  theory  formulation  of  the  ob- 
server problem.  The  following  two  correspondences  can  be  made  immediately. 
The  pole  placement  algorithm  of  Kalman  (1971a)  corresponds  to  Algorithm 
(2.78),  and  the  pole  placement  algorithm  of  Wonham  (1967)  corresponds  to 
the  partial  realization  algorithm  of  Ackermann  (1972)  (which  is  outlined, 
in  dual  context,  in  Remark  (2.83)).  ^ 

(4.74)  Intermediate  order  observer  design  of  Fortmann  and  Williamson 
(1972).   This  is  a  low  order  observer  design  procedure  (for  vector  li- 
near functions  of  the  state)  based  on  the  same  concept  as  (4.57).   Con- 
sider the  plant  (4.1)  with  the  pair  (F,H)   given  in  the  form  (4.26)- 
(4.27).   Partition  the  state  x  and  matrix  K  corresponding  to  the  subsys- 
tems in  (4.1).   That  is, 

//  -,cx  T    r  T    T  T, 

(4.75)  2i  "^  [2ii   iio    •  •  •   X  J 

(4.76)  K  =  [K^   &2  •  •  •  \^ 

where  x.  is  v.xl  and  K.  is  mxv . .   It  follows  that 
—11        11 

(4.77)  Kx  =  K^x^  +  ^^2X2  +  •  .  .  +  K_x 


Kortmann  and  Williamson  (1972)  estimate  each  K.x.  with  a  subobserver, 

1—1 

and  add  the  outputs  of  the  r  subobservers  to  obtain  an  asymptotic  esti- 
mate of  Kx.   The  subobservers  they  design  for  the  feedback  control  law 
K.x.  of  each  multiple  input,  single  output  subsystem  are  minimal  order 
subobservers.   But  it  does  not  follow  (except  in  unusual  circumstances) 
that  the  overall  observer  formed  by  the  uncoupled  parallel  combination 
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of  the  subobservers  is  a  minimal  order  observer  for  the  total  feedback 
control  law  Kx  of  the  multiple  input/output  plant  (4.1). 

The  partial  realization  algorithm  corresponding  to  this  particular 
observer  design  is  the  stable  (rather  than  arbitrary)  version  of  the 
algorithm  outlined  in  the  proof  of  Theorem  (3.22).  y 

(4.78)   Intermediate  order  observer  design  of  Murdoch  (1974).   An  out- 
line of  this  observer  design  procedure  is  as  follows.   Consider  the  plant 
(4.1)  and  the  feedback  control  law  (4.2).   Define  K  in  terms  of  its  rows 
as 

-1 

k^ 
-2 


(4.79) 


K  = 


k^ 
— m 


J 


Design  a  subobserver  of  dimension  V  -  1  and  arbitrary  poles  to  observe 
the  first  linear  function,  k^x,  using  any  one  of  several  techniques 
(Luenberger,  1966;  Williamson,  1970;  Wonham  and  Morse,  1972;  Wolovich, 
1973a;  Murdoch,  1973;  Wang  and  Davison,  1973;  Roman  et  al.,  1973).   Let 

z^  and  w^  be  the  state  and  output,  respectively,  of  this  subobserver, 

and  let  T^  be  the  linear  transformation  of  x  to  which  z^  is  asymptotic; 

that  is,  z^  ^  T^x  and  w^  ->  k]^x  as  t  ^  «,. 

In  the  steady-state,  z^   =  T^x.   This  can  be  used  advantageously  to 

design  subobservers  for  the  remaining  scalar  linear  functions  as  follows, 

Define  R^   to  be  the  following  (r+v-l)xn  matrix 

"h 


s- 


1 
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Both  z      and  y_   provide  information  about  x-   Further,  assuming  the  largest 

T 
chain  in  k   is  non-zero,  the  information  provided  by  z   is  linearly  inde- 
pendent of  the  information  contained  in  ^  (see  Theorem  (4.50)).   This  im- 
plies  H^  has  full  rank.   (If  the  largest  chain  in  k   is  a  null  chain, 
then  r  <  p(H„)  <^  r  +  V  -  1  because  some  rows  of  T  may  be  a  linear  com- 
bination of  the  other  rows  in  H  .)   Then  the  information  available  in 

T 
z^^  and  in  y  is  used  to  observe  k_x  with  a  subobserver  of  dimension  V   -  1 

and  arbitrary  poles,  where  V   is  the  observability  index  of  the  pair 

(F,H„)  . 
z  n 

The  remaining  scalar  linear  functions  are  observed  using  the  same 
principle.   Let  H^  be  the  following  (r+v+V  +. . .+V._  +i-l)xn  matrix 

"h 


(4.80) 


H.  = 

X 


i-1 

Generally,  p(H  )  >  p(H.   ).   It  follows  that  v.  <  v.  ,,  where  v  is  the 
11-1  1  =  1-1'        j 

observability  index  of  the  pair  (F,H.)  .   Then  the  information  available 

J  n 

in  z^,    z^,    .,.,  z.^_p  and  _y.  is  used  to  design  the  ith  subobserver  (which 

T 
estimates  k  x)  of  dimension  V.  -  1  and  arbitrary  poles. 

The  overall  observer  has  dimension  p=v+V-+...+v  =m< 

2  m     = 

m(v  -  1),  consists  of  a  cascade  of  m  subobservers  coupled  in  the  forward 
direction  only,  and  has  arbitrary  poles  (except  that  some  may  be  con- 
strained to  be  real).   The  overall  observer  system  matrix,  A,  has  (block) 
lower-triangular  form  and  (practically)  arbitrary  eigenvalues.   The  co- 
ordinates in  which  the  overall  observer  is  represented  depend  on  the 
procedures  used  to  design  the  subobservers. 
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Suppose  the  subobservers  are  designed  to  be  minimal  order  subobser- 
vers  rather  than  minimal  order  arbitrary  observers;  then,  it  is  evident 
that  an  observer  designed  as  in  (4.74)  will  generally  have  dimension 
larger  than  an  observer  designed  following  the  above  procedure.   But 
whichever  the  case  in  question  (whether  minimal  order  or  minimal  order 
arbitrary  observers),  the  design  procedure  of  Murdoch  (1974)  is  often 
non-minimal  and  less  general  than  the  observer  design  procedure  proposed 
in  this  chapter. 

Designing  an  intermediate  order  observer  according  to  Murdoch  (1974) 
is  equivalent  to  using  the  algorithm  of  Ackermann  (1972)  to  solve  the 
partial  realization  problem  formulated  from  the  observer  design  problem. 
It  has  been  shown  (see  Remark  (2.83)  and  Example  (2.85))  that  a  partial 
realization  obtained  using  Ackermann' s  (1972)  algorithm  is  often  non- 
minimal  and  less  general  than  a  partial  realization  obtained  using 
Algorithm  (2.78).  V 

As  previously  mentioned,  there  are  several  other  full-state  and  in- 
termediate order  observer  design  procedures  that  remain  to  be  investiga- 
ted in  the  partial  realization  theory  context.   Notably  among  these  is 
the  design  algorithm  proposed  by  Wang  and  Davison  (1973).   Their  results 
are  discussed  briefly  next  (see  also  Chapter  1). 

Wang  and  Davison  (1973)  consider  the  problem  of  observing  vector 
linear  functions  of  the  state  with  a  minimal  order  observer,  and  approach 
the  problem  from  the  matrix-fraction  rather  than  the  state-space  point 
of  view.   Their  procedure  gives  a  minimal  order  system  which  satisfies 
all  the  requirements  of  an  observer,  except  possibly  stability.   This 
agrees  with  the  results  given  here  because  the  minimal  partial  realiza- 
tion of  the  finite  matrix  sequence  formed  from  the  given  observer  design 
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problem  may  not  be  stable.   Wang  and  Davison  (1973)  do  not  give  a  proce- 
dure to  obtain  a  higher  order  but  stable  system  in  the  cases  where  the 
minimal  order  system  is  unstable. 

The  relationships  which  exist  between  state-space  and  matrix-fraction 
descriptions  (see  Theorems  (2.54)  and  (2.60))  suggest  that  there  must  be 
matrix-fraction  description  counterparts  for  the  state-space  description 
results  of  this  dissertation.  The  work  of  Dickinson  et  al.  (1974a,  b) 
gives  more  support  to  this  conjecture.   Further  research  in  this  problem 
is  needed. 

The  example  given  below  illustrates  the  power  and  generality  of  the 
realization  theory  approach  to  solve  an  observer  design  problem.  The 
dimension  and  number  of  arbitrary  poles  of  a  minimal  order  observer 
which  estimates  a  class  of  feedback  control  laws  for  plants  of  dimension 
equal  to  five  and  a  specified  output  structure  are  obtained  in  the  example. 
(4.81)   Example.   Consider  any  fifth-order,  two-input,  two-output  plant 
which  has  observability  indices  V  =  3  and  v  =  2,  and  suppose  the  plant 
is  given  in  the  coordinates  (4. 26)- (4. 27) .   (A  plant  with  observability 
indices  V   =  2  and  V„  =  3  is  converted  to  one  with  observability  indices 
V  =  3  and  v„  =  2  by  reordering  the  two  outputs.)   Consider  also  all 
full-rankfeedbackmatric.es  K  given  in  the  same  coordinates  as  the  plant. 
It  is  desired  to  study  the  class  of  feedback  control  laws  that  can  be 
estimated  with  a  minimal  order  observer.   Only  full-rank  feedback  ma- 
trices are  considered  because  otherwise  the  problem  reduces  to  observ- 
ing a  scalar  linear  function  of  the  state. 

In  view  of  Theorem  (4.34)  and  Corollary  (4.38),  it  is  necessary 
to  study  only  the  possible  partial  realizations  of  a  matrix  sequence 
formed  from  the  columns  of  K   (the  first  three  columns  of  K) .  Following 
(4.35),  label  the  elements  of  K  as  follows 
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•^1  =  ^hl       hi       ^21^  = 


h        S       S 
^2   ^6   ^4 


The  incompletely  specified  matrix  sequence  formed  according  to  (4.36)  is 
given  by 


h    = 


^2  = 


k. 


8 


where  5   and  E,      are  unspecified  elements;  the  corresponding  Hankel 
array  is 


3f„ 


22 


"1 


K- 


The  dimension  of  the  minimal  order  observer  depends  on  the  rank  of  ^     . 
To  investigate  the  minimal  rank  of  Jf    the  unspecified  elements 

(?7»  ?g.  and  the  asterisks)are  neglected.   The  following  observations 
can  be  made  by  inspection  of  the  rows  of  K     .      Since  K  has  full  rank 

(p(Kp  =  2),  the  minimal  rank  of  3f   cannot  be  less  than  two  and  cannot 
be  more  than  three.   Also,  it  will  be  equal  to  three  if  and  only  if 
iii]^  ~  9.'      The  following  conclusion  can  be  reached  immediately:   the 
minimal  order  observer  has  dimension  equal  to  three  and  arbitrary  poles 
if  k^^  =  0. 

To  proceed  with  the  discussion,  let  k  ^  0_.  Then  the  minimal  par- 
tial realization  of  the  sequence  has  dimension  equal  to  two  and  (by  in- 
spection) it  is  given  in  its  most  general  form  by  the  triple 


A  = 


HI 


-Y 


-Y 


121 


211 


221 


Q  = 


1    0 

0    1 


D  = 


1 


^2     '^4^ 
where  Y2,i^  and  Y221  ^^^   completely  arbitrary,  and 


•^5 


'1 


Y 


Y 


111 


121 


The  characteristic  polynomial  of  A  is  given  by 
6(s)  =  s'  +  B^s  +   6^ 

B(s)  =  s^  +  (Y^^^  +  Y22i)s  +  Y111Y221  -  Y121Y2U 
Notice  that  any  two  given  coefficients  S,  and  6   can  be  matched  with 
an  appropriate  choice  of  y^^^    and  Y221  i^  a"'^  only  if  Y,2i  ^   ^-      ^t 
follows  immediately  that  the  minimal  order  observer  has  dimension  equal 
to  two  and  arbitrary  poles  if  and  only  if  k,  ,  '^   0   and  k   is  linearly 
independent  of  k      ■ 

It  remains  to  consider  the  consequences  of  k   being  linearly  de- 
pendent on  k^^.   Let  Yj^2l  "  °  ^^^  '^ m   ^   ^    (^his  insures  k   ^   0).   Then 

^1  "  "^111^221 

^2  "  ^111  ^  ^221 
For  stability,  it  is  necessary  and  sufficient  that  6  >  0  and  6„  >  0; 
this,  in  turn,  implies  Y^^^  >  0  and  Y221  >  ^-      ^ut  Y221  is  arbitrary, 
so  stability  is  guaranteed  if  y, , ,  >  0. 

This  result  is  combined  with  the  previous  ones  into  the  following 
statements. 
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a)  The  minimal  order  observer  has  dimension  equal  to 
three  and  arbitrary  poles  if  and  only  if 

i)  ^11   =  0 

or   ii)   k^2  =  "  "^m^u  "^^^^   '^111  =  °- 

b)  The  minimal  order  observer  has  dimension  equal  to 

two  and  arbitrary  poles  if  and  only  if  k   7^  ^  and 
k  „  is  linearly  independent  of  k, , • 

c)  The  minimal  order  observer  has  dimension  equal  to 
two,  one  pole  arbitrary  (but  real),  and  the  other 
pole  at  -Yi,,  if  and  only  if  k   ^   0   and  k  „  = 

-^111^11  "^^h  ^111  "  °- 
It  is  emphasized  that  these  statements  are  true  given  the  triple  (F,G,H) 

and  matrix  K  in  the  coordinates  of  Lemma  (4.25). 

The  above  statements  characterize  the  classes  of  full-rank  feedback 
matrices  for  the  control  law  (4.2)  that  can  be  estimated  with  a  minimal 
order  observer  for  all  fifth-order,  two-input,  two-output  plants  which 
have  observability  indices  given  by  the  set  {3,2}.   Almost  quite  as 
remarkable  as  this  result  itself  is  the  ease  with  which  it  was  obtained. V 

Example  (4.81)  illustrates  some  of  the  types  of  results  that  can 
be  obtained  by  studying  observer-plant  relationships  via  partial  reali- 
zation theory.   Of  course,  as  the  dimension  of  the  plant  increases  and 
its  output  structure  becomes  more  complex,  the  amount  of  work  involved 
increases  at  a  large  rate  and  it  may  not  be  possible  to  be  as  conclusive 
as  in  Example  (4.81),  but  it  may  still  be  possible  to  obtain  results  in 
terms  of  necessary  conditions  and  sufficient  conditions. 
(4.82)   Remark.   A  significant  point  is  brought  to  light  in  Example 
(4.81).   Consider  the  necessary  conditions  and  the  sufficient  conditions 
of  Theorem  (4.55).   For  this  example,  these  conditions  imply 
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a)  1  <  y^  <  2 

b)  ^2  "^  ^ 

c)  2  £  p  <  3 

But  is  does  not  seem  to  be  possible  to  make  more  definite  conclusions 
(regarding  the  dimension  and  structure  of  the  minimal  order  observer) 
unless  K  is  specified.   This  suggests  that  (for  multiple  input/output 
plants)  there  may  not  exist  a  stronger  set  of  conditions  than  those 
listed  in  Theorem  (4.55).   It  is  interesting  to  notice  that  the  bounds 
for  the  dimension  of  the  minimal  order  observer  listed  in  Remark 
(4.43)  give   p  >  2.  \ 

The  results  presented  in  this  chapter  extend  the  available  theory 
considerably,  but  there  still  remain   several  details  to  be  investigated 
further  and  various  possible  extensions  to  be  considered.   This  is  dis- 
cussed more  amply  in  the  following  chapter. 


CHAPTER  5 
CONCLUDING  REMARKS 

A  summary  of  the  contributions  of  this  dissertation  and  suggestions 
for  future  research  are  given  below. 

Summary 

This  dissertation  contains  contributions  to  both  realization  theory 
and  observer  design  theory.   The  major  contributions  are  outlined  next  by 
chapters. 

The  problem  of  obtaining  a  complete  system  of  invariants  for  the 
equivalence  classes  defined  by  similarity  transformations  on  the  state- 
space  of  linear,  constant  systems  is  discussed  in  Chapter  2.   A  corre- 
sponding set  of  canonical  forms  is  defined.   This  leads  naturally  to  the 
formulation  of  an  algorithm  to  realize  infinite  matrix  sequences  with 
linear,  constant  systems  represented  by  matrix  triples.   Similar  algo- 
rithms were  previously  available  (Bonivento  et  al. ,  1973;   Rissanen, 
1974),  but  several  significant  points  are  discussed  here  which  seem  to 
have  been  overlooked  elsewhere. 

The  problem  of  realizing  a  finite  matrix  sequence  with  a  linear, 
constant  system  is  also  considered  in  Chapter  2.   A  new  partial  realiza- 
tion algorithm  which  identifies  the  minimal  number  of  parameters  while 
conserving  all  the  available  degrees  of  freedom  is  given.   This  feature 
of  the  algorithm  allows  a  simple  parametrlzation  of  all  minimal  partial 
realizations  of  a  given  finite  matrix  sequence.   It  is  shown  that  this 
algorithm  has  definite  advantages  over  existing  minimal  partial  realiza- 
tion algorithms  (Tether,  1970;   Kalman,  1971b;  Ackermann,  1972). 
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Three  non-minimal  partial  realization  algorithms  are  discussed  in 
Chapter  3.   These  algorithms  can  be  effectively  used  to  obtain  all  mini- 
mal partial  stable  realizations,  all  minimal  partial  arbitrary  realiza- 
tions, and  all  partial  realizations  of  a  specified  dimension  (and  possi- 
bly also  a  desired  property  like  decoupled  structure,  etc.)  for  a  given 
finite  matrix  sequence.   The  approach  taken  in  this  work  sheds  consider- 
able light  into  these  problems  and  allows  the  statement  of  necessary 
conditions  and/or  sufficient  conditions  for  a  realization  of  a  specified 
dimension  and  stable  or  arbitrary  poles  to  exist  for  a  given  finite  ma- 
trix sequence.   Further,  significant  observations  like  Remark  (3.35) 
come  quite  naturally  with  the  approach  followed  here. 

In  Chapter  4  the  design  of  intermediate  order  and  minimal  order 
observers  to  estimate  vector  linear  functions  of  the  state  is  discussed. 
It  is  shown  that  an  observer  design  problem  can  be  formulated  in  all 
cases  as  a  partial  realization  problem  where,  generally,  some  columns  of 
some  of  the  matrices  in  the  sequence  are  unspecified.   Then  the  machine- 
ry developed  in  Chapters  2  and  3  is  applied  to  the  design  of  observers. 
The  available  results  for  single  input  and/or  single  output  plants  are 
extended  to  their  limit  (necessary  and  sufficient  conditions  are  stated 
for  these  cases),  and  several  new  results  are  given  for  the  problems  of 
observing  vector  linear  functions  of  the  state  of  multiple  output  plants 
with  minimal  order  observers  and  minimal  order  arbitrary  observers.   It 
is  also  shown  that  the  dynamics  of  an  observer  which  approximates  a  giv- 
en feedback  control  law  are  constrained  exclusively  by  the  values  of  the 
feedback  matrix  in  the  control  law  and  the  observability  indices  of  the 
plant.   Several  observer  design  techniques  are  examined  in  the  light  of 
partial  realization  theory  and  compared  with  the  observer  design  proce- 
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dure  presented  here.   This  type  of  study  yields  considerable  insight 
into  the  respective  observer  design  techniques.   The  strength  of  the 
partial  realization  theory  approach  to  the  design  of  observers  is  demon- 
strated in  Example  (4.81). 

Suggestions  for  Future  Research 
The  results  given  in  this  dissertation  open  up  several  interesting 
possibilities  for  future  research  work.   These  vary  from  problems  deal- 
ing with  further  polishing  of  various  points  to  problems  concerned  with 
extensions  of  several  of  the  results.   The  following  problems  can  be 
immediately  posed. 

a)  It  is  important  to  study  further  the  relationships  which 
exist  between  the  number  of  degrees  of  freedom  in  par- 
tial realizations  of  finite  matrix  sequences  and  the 
corresponding  number  of  arbitrary  realization  poles  and 
the  stability  of  the  realizations.   These  problems 
should  be  examined  in  the  light  of  the  decidability 
theory  developed  recently  by  Anderson  et  al.  (1975). 

b)  The  question  of  equivalence  relations  and  the  associated 
invariants  for  the  problems  of  obtaining  minimal  partial 
stable  and  minimal  partial  arbitrary  realizations  of  a 
finite  matrix  sequence  should  be  studied  in  more  detail. 
The  work  of  Morse  (1972)  may  provide  a  basis  for  such  a 
study. 

c)  It  seems  that  a  correspondence  exists  between  the  matrix- 
fraction  description  approach  to  observer  design  of  Wang 
and  Davison  (1973)  and  the  state-space  approach  to  ob- 
server design  via  partial  realization  theory  developed 
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here.   This  .ay  lead  to  new  applications  of  realization 
theory. 

d)   Several  of  the  available  observer  design  techniques  are 
examined  in  Chapter  4  in  the  partial  realization  theory 
framework.   It  is  interesting  to  study  the  correspon- 
dence (if  any)  with  partial  realization  algorithms  of 
those  observer  design  techniques  that  are  not  considered 


here. 


e)   It  remains  to  investigate  whether  the  results  given  in 
this  dissertation  can  be  extended  or  applied  in  any  for. 
to  the  realization  of  stochastic  systems  and  to  the  de- 
sign of  adaptive  observers,  stochastic  observer-estima- 
tors, observers  for  nonlinear  systems  (particularly  bi- 
linear  systems),  etc. 


B 
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